Apr 11 16:58:50 user nova-compute[71063]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 16:58:52 user nova-compute[71063]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71063) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 16:58:52 user nova-compute[71063]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71063) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 16:58:52 user nova-compute[71063]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71063) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 16:58:52 user nova-compute[71063]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 16:58:53 user nova-compute[71063]: INFO nova.virt.driver [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 16:58:53 user nova-compute[71063]: INFO nova.compute.provider_config [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Acquiring lock "singleton_lock" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Acquired lock "singleton_lock" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Releasing lock "singleton_lock" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Full set of CONF: {{(pid=71063) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ******************************************************************************** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Configuration options gathered from: {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ================================================================================ {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] allow_resize_to_same_host      = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] arq_binding_timeout            = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] backdoor_port                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] backdoor_socket                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] block_device_allocate_retries  = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] block_device_allocate_retries_interval = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cert                           = self.pem {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute_monitors               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] config_dir                     = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] config_drive_format            = iso9660 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] config_source                  = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] console_host                   = user {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] control_exchange               = nova {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cpu_allocation_ratio           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] daemon                         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] debug                          = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] default_access_ip_network_name = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] default_availability_zone      = nova {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] default_ephemeral_format       = ext4 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] default_schedule_zone          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] disk_allocation_ratio          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] enable_new_services            = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] enabled_apis                   = ['osapi_compute'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] enabled_ssl_apis               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] flat_injected                  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] force_config_drive             = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] force_raw_images               = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] graceful_shutdown_timeout      = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] heal_instance_info_cache_interval = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] host                           = user {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_build_timeout         = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_delete_interval       = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_format                = [instance: %(uuid)s]  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_name_template         = instance-%08x {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_usage_audit           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_usage_audit_period    = month {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] internal_service_availability_zone = internal {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] key                            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] live_migration_retry_count     = 30 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_config_append              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_dir                        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_file                       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_options                    = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_rotate_interval            = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_rotate_interval_type       = days {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] log_rotation_type              = none {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] long_rpc_timeout               = 1800 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_concurrent_builds          = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_concurrent_live_migrations = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_concurrent_snapshots       = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_local_block_devices        = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_logfile_count              = 30 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] max_logfile_size_mb            = 200 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] maximum_instance_delete_attempts = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metadata_listen                = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metadata_listen_port           = 8775 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metadata_workers               = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] migrate_max_retries            = -1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] mkisofs_cmd                    = genisoimage {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] my_ip                          = 10.0.0.210 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] network_allocate_retries       = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] osapi_compute_listen_port      = 8774 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] osapi_compute_unique_server_name_scope =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] osapi_compute_workers          = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] password_length                = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] periodic_enable                = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] periodic_fuzzy_delay           = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] pointer_model                  = ps2mouse {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] preallocate_images             = none {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] publish_errors                 = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] pybasedir                      = /opt/stack/nova {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ram_allocation_ratio           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rate_limit_burst               = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rate_limit_except_level        = CRITICAL {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rate_limit_interval            = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reboot_timeout                 = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reclaim_instance_interval      = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] record                         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reimage_timeout_per_gb         = 20 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] report_interval                = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rescue_timeout                 = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reserved_host_cpus             = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reserved_host_disk_mb          = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reserved_host_memory_mb        = 512 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] reserved_huge_pages            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] resize_confirm_window          = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] resize_fs_using_block_device   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] resume_guests_state_on_host_boot = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rpc_response_timeout           = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] run_external_periodic_tasks    = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] running_deleted_instance_action = reap {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] running_deleted_instance_poll_interval = 1800 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] running_deleted_instance_timeout = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler_instance_sync_interval = 120 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_down_time              = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] servicegroup_driver            = db {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] shelved_offload_time           = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] shelved_poll_interval          = 3600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] shutdown_timeout               = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] source_is_ipv6                 = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ssl_only                       = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] state_path                     = /opt/stack/data/nova {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] sync_power_state_interval      = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] sync_power_state_pool_size     = 1000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] syslog_log_facility            = LOG_USER {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] tempdir                        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] timeout_nbd                    = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] transport_url                  = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] update_resources_interval      = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_cow_images                 = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_eventlog                   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_journal                    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_json                       = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_rootwrap_daemon            = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_stderr                     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] use_syslog                     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vcpu_pin_set                   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plugging_is_fatal          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plugging_timeout           = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] virt_mkfs                      = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] volume_usage_poll_interval     = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] watch_log_file                 = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] web                            = /usr/share/spice-html5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_concurrency.disable_process_locking = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.auth_strategy              = keystone {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.compute_link_prefix        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.dhcp_domain                = novalocal {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.enable_instance_password   = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.glance_link_prefix         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.instance_list_per_project_cells = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.list_records_by_skipping_down_cells = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.local_metadata_per_cell    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.max_limit                  = 1000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.metadata_cache_expiration  = 15 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.neutron_default_tenant_id  = default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.use_forwarded_for          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.use_neutron_default_nets   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_dynamic_targets = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_jsonfile_path   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.backend                  = dogpile.cache.memcached {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.backend_argument         = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.config_prefix            = cache.oslo {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.dead_timeout             = 60.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.debug_cache_backend      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.enable_retry_client      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.enable_socket_keepalive  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.enabled                  = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.expiration_time          = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.hashclient_retry_attempts = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_dead_retry      = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_password        =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_pool_maxsize    = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_sasl_enabled    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.memcache_username        =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.proxies                  = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.retry_attempts           = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.retry_delay              = 0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.socket_keepalive_count   = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.socket_keepalive_idle    = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.socket_keepalive_interval = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.tls_allowed_ciphers      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.tls_cafile               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.tls_certfile             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.tls_enabled              = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cache.tls_keyfile              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.auth_section            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.auth_type               = password {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.cafile                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.certfile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.collect_timing          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.cross_az_attach         = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.debug                   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.endpoint_template       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.http_retries            = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.insecure                = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.keyfile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.os_region_name          = RegionOne {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.split_loggers           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cinder.timeout                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.cpu_dedicated_set      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.cpu_shared_set         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.image_type_exclude_list = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.max_concurrent_disk_ops = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.max_disk_devices_to_attach = -1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.resource_provider_association_refresh = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.shutdown_retry_interval = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] conductor.workers              = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] console.allowed_origins        = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] console.ssl_ciphers            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] console.ssl_minimum_version    = default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] consoleauth.token_ttl          = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.cafile                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.certfile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.collect_timing          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.connect_retries         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.connect_retry_delay     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.endpoint_override       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.insecure                = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.keyfile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.max_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.min_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.region_name             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.service_name            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.service_type            = accelerator {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.split_loggers           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.status_code_retries     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.timeout                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] cyborg.version                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.backend               = sqlalchemy {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.connection            = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.connection_debug      = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.connection_parameters =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.connection_recycle_time = 3600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.connection_trace      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.db_inc_retry_interval = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.db_max_retries        = 20 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.db_max_retry_interval = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.db_retry_interval     = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.max_overflow          = 50 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.max_pool_size         = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.max_retries           = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.mysql_enable_ndb      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.mysql_wsrep_sync_wait = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.pool_timeout          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.retry_interval        = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.slave_connection      = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] database.sqlite_synchronous    = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.backend           = sqlalchemy {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.connection        = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.connection_debug  = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.connection_parameters =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.connection_recycle_time = 3600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.connection_trace  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.db_inc_retry_interval = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.db_max_retries    = 20 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.db_max_retry_interval = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.db_retry_interval = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.max_overflow      = 50 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.max_pool_size     = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.max_retries       = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.mysql_enable_ndb  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.pool_timeout      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.retry_interval    = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.slave_connection  = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] api_database.sqlite_synchronous = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] devices.enabled_mdev_types     = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ephemeral_storage_encryption.enabled = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.api_servers             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.cafile                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.certfile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.collect_timing          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.connect_retries         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.connect_retry_delay     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.debug                   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.default_trusted_certificate_ids = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.enable_certificate_validation = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.enable_rbd_download     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.endpoint_override       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.insecure                = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.keyfile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.max_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.min_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.num_retries             = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.rbd_ceph_conf           =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.rbd_connect_timeout     = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.rbd_pool                =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.rbd_user                =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.region_name             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.service_name            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.service_type            = image {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.split_loggers           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.status_code_retries     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.timeout                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.verify_glance_signatures = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] glance.version                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] guestfs.debug                  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.config_drive_cdrom      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.config_drive_inject_password = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.enable_instance_metrics_collection = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.enable_remotefx         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.instances_path_share    =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.iscsi_initiator_list    = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.limit_cpu_features      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.power_state_check_timeframe = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.use_multipath_io        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.volume_attach_retry_count = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.vswitch_name            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] mks.enabled                    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.manager_interval   = 2400 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.precache_concurrency = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.remove_unused_base_images = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] image_cache.subdirectory_name  = _base {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.api_max_retries         = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.api_retry_interval      = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.auth_section            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.auth_type               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.cafile                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.certfile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.collect_timing          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.connect_retries         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.connect_retry_delay     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.endpoint_override       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.insecure                = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.keyfile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.max_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.min_version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.partition_key           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.peer_list               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.region_name             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.serial_console_state_timeout = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.service_name            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.service_type            = baremetal {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.split_loggers           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.status_code_retries     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.timeout                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ironic.version                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] key_manager.fixed_key          = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.barbican_api_version  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.barbican_endpoint     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.barbican_endpoint_type = public {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.barbican_region_name  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.cafile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.certfile              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.collect_timing        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.insecure              = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.keyfile               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.number_of_retries     = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.retry_delay           = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.send_service_user_token = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.split_loggers         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.timeout               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.verify_ssl            = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican.verify_ssl_path       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.auth_section = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.auth_type = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.cafile   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.certfile = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.collect_timing = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.insecure = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.keyfile  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.split_loggers = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] barbican_service_user.timeout  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.approle_role_id          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.approle_secret_id        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.cafile                   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.certfile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.collect_timing           = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.insecure                 = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.keyfile                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.kv_mountpoint            = secret {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.kv_version               = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.namespace                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.root_token_id            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.split_loggers            = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.ssl_ca_crt_file          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.timeout                  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.use_ssl                  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.cafile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.certfile              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.collect_timing        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.connect_retries       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.connect_retry_delay   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.endpoint_override     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.insecure              = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.keyfile               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.max_version           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.min_version           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.region_name           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.service_name          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.service_type          = identity {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.split_loggers         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.status_code_retries   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.timeout               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] keystone.version               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.connection_uri         =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_mode               = custom {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: WARNING oslo_config.cfg [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_power_governor_high = performance {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_power_governor_low = powersave {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_power_management   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.device_detach_attempts = 8 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.device_detach_timeout  = 20 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.disk_cachemodes        = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.disk_prefix            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.enabled_perf_events    = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.file_backed_memory     = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.gid_maps               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.hw_disk_discard        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.hw_machine_type        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_rbd_glance_store_name =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_rbd_pool        = rbd {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_type            = default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.images_volume_group    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.inject_key             = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.inject_partition       = -2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.inject_password        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.iscsi_iface            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.iser_use_multipath     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_bandwidth = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_downtime = 500 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_inbound_addr = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_permit_post_copy = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_scheme  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_timeout_action = abort {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_tunnelled = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: WARNING oslo_config.cfg [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 16:58:53 user nova-compute[71063]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 16:58:53 user nova-compute[71063]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 16:58:53 user nova-compute[71063]: and ``live_migration_inbound_addr`` respectively.
Apr 11 16:58:53 user nova-compute[71063]: ).  Its value may be silently ignored in the future.
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.live_migration_with_native_tls = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.max_queues             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.nfs_mount_options      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_memory_encrypted_guests = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_pcie_ports         = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.pmem_namespaces        = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.quobyte_client_cfg     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rbd_secret_uuid        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rbd_user               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.remote_filesystem_transport = ssh {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rescue_image_id        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rescue_kernel_id       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rescue_ramdisk_id      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.rx_queue_size          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.smbfs_mount_options    =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.snapshot_compression   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.snapshot_image_format  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.sparse_logical_volumes = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.swtpm_enabled          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.swtpm_group            = tss {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.swtpm_user             = tss {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.sysinfo_serial         = unique {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.tx_queue_size          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.uid_maps               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.use_virtio_for_bridges = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.virt_type              = kvm {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.volume_clear           = zero {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.volume_clear_size      = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.volume_use_multipath   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_cache_path   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.vzstorage_mount_user   = stack {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.auth_section           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.auth_type              = password {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.cafile                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.certfile               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.collect_timing         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.connect_retries        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.connect_retry_delay    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.default_floating_pool  = public {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.endpoint_override      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.extension_sync_interval = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.http_retries           = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.insecure               = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.keyfile                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.max_version            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.min_version            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.ovs_bridge             = br-int {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.physnets               = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.region_name            = RegionOne {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.service_metadata_proxy = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.service_name           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.service_type           = network {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.split_loggers          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.status_code_retries    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.timeout                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] neutron.version                = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] notifications.bdms_in_notifications = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] notifications.default_level    = INFO {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] notifications.notification_format = unversioned {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] notifications.notify_on_state_change = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] pci.alias                      = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] pci.device_spec                = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] pci.report_in_placement        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.auth_section         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.auth_type            = password {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.cafile               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.certfile             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.collect_timing       = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.connect_retries      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.connect_retry_delay  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.default_domain_id    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.default_domain_name  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.domain_id            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.domain_name          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.endpoint_override    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.insecure             = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.keyfile              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.max_version          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.min_version          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.password             = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.project_domain_id    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.project_domain_name  = Default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.project_id           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.project_name         = service {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.region_name          = RegionOne {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.service_name         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.service_type         = placement {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.split_loggers        = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.status_code_retries  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.system_scope         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.timeout              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.trust_id             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.user_domain_id       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.user_domain_name     = Default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.user_id              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.username             = placement {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] placement.version              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.cores                    = 20 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.count_usage_from_placement = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.injected_file_content_bytes = 10240 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.injected_file_path_length = 255 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.injected_files           = 5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.instances                = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.key_pairs                = 100 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.metadata_items           = 128 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.ram                      = 51200 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.recheck_quota            = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.server_group_members     = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] quota.server_groups            = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rdp.enabled                    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.image_metadata_prefilter = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.max_attempts         = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.max_placement_results = 1000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.query_placement_for_availability_zone = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.query_placement_for_image_type_support = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] scheduler.workers              = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.host_subset_size = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.isolated_hosts = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.isolated_images = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.pci_in_placement = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.track_instance_changes = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metrics.required               = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metrics.weight_multiplier      = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] metrics.weight_setting         = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.enabled         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.port_range      = 10000:20000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] serial_console.serialproxy_port = 6083 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.auth_section      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.auth_type         = password {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.cafile            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.certfile          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.collect_timing    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.insecure          = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.keyfile           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.send_service_user_token = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.split_loggers     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] service_user.timeout           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.agent_enabled            = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.enabled                  = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.html5proxy_port          = 6082 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.image_compression        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.jpeg_compression         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.playback_compression     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.server_listen            = 127.0.0.1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.streaming_mode           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] spice.zlib_compression         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] upgrade_levels.baseapi         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] upgrade_levels.cert            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] upgrade_levels.compute         = auto {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] upgrade_levels.conductor       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] upgrade_levels.scheduler       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.auth_section = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.auth_type = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.cafile = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.certfile = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.insecure = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.keyfile = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vendordata_dynamic_auth.timeout = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.api_retry_count         = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.ca_file                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.cache_prefix            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.cluster_name            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.connection_pool_size    = 10 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.console_delay_seconds   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.datastore_regex         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.host_ip                 = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.host_password           = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.host_port               = 443 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.host_username           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.insecure                = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.integration_bridge      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.maximum_objects         = 100 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.pbm_default_policy      = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.pbm_enabled             = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.pbm_wsdl_location       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.serial_port_proxy_uri   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.serial_port_service_uri = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.task_poll_interval      = 0.5 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.use_linked_clone        = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.vnc_keymap              = en-us {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.vnc_port                = 5900 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vmware.vnc_port_total          = 10000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.auth_schemes               = ['none'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.enabled                    = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.novncproxy_port            = 6080 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.server_listen              = 0.0.0.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.vencrypt_ca_certs          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.vencrypt_client_cert       = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vnc.vencrypt_client_key        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.disable_rootwrap   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.enable_numa_live_migration = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.libvirt_disable_apic = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.client_socket_timeout     = 900 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.default_pool_size         = 1000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.keep_alive                = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.max_header_line           = 16384 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.ssl_ca_file               = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.ssl_cert_file             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.ssl_key_file              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.tcp_keepidle              = 600 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] zvm.ca_file                    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] zvm.cloud_connector_url        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] zvm.reachable_timeout          = 300 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.enforce_new_defaults = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.enforce_scope      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.policy_default_rule = default {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.policy_file        = policy.yaml {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.connection_string     = messaging:// {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.enabled               = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.es_doc_type           = notification {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.es_scroll_size        = 10000 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.es_scroll_time        = 2m {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.filter_error_trace    = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.sentinel_service_name = mymaster {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.socket_timeout        = 0.1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] profiler.trace_sqlalchemy      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] remote_debug.host              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] remote_debug.port              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_notifications.retry = -1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_messaging_notifications.transport_url = **** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.auth_section        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.auth_type           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.cafile              = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.certfile            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.collect_timing      = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.connect_retries     = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.connect_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.endpoint_id         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.endpoint_override   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.insecure            = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.keyfile             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.max_version         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.min_version         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.region_name         = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.service_name        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.service_type        = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.split_loggers       = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.status_code_retries = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.status_code_retry_delay = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.timeout             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.valid_interfaces    = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_limit.version             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_reports.file_event_handler = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] oslo_reports.log_dir           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.group  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] vif_plug_ovs_privileged.user   = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.flat_interface = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.isolate_vif         = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_vif_ovs.per_port_bridge     = False {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] os_brick.lock_path             = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.capabilities   = [21] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.group          = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.helper_command = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] privsep_osbrick.user           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.group           = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.helper_command  = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] nova_sys_admin.user            = None {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG oslo_service.service [None req-29537c59-0649-40bc-bdf6-b7a8a947fd1a None None] ******************************************************************************** {{(pid=71063) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 16:58:53 user nova-compute[71063]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Starting native event thread {{(pid=71063) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Starting green dispatch thread {{(pid=71063) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Starting connection event dispatch thread {{(pid=71063) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Connecting to libvirt: qemu:///system {{(pid=71063) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fbebd6ba5f0> {{(pid=71063) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fbebd6ba5f0> {{(pid=71063) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 16:58:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Connection event '1' reason 'None'
Apr 11 16:58:53 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 16:58:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.mount [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Initialising _HostMountState generation 0 {{(pid=71063) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host capabilities <capabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <host>
Apr 11 16:59:01 user nova-compute[71063]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 16:59:01 user nova-compute[71063]:     <cpu>
Apr 11 16:59:01 user nova-compute[71063]:       <arch>x86_64</arch>
Apr 11 16:59:01 user nova-compute[71063]:       <model>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <microcode version='1070'/>
Apr 11 16:59:01 user nova-compute[71063]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='osxsave'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='invtsc'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='rsba'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 16:59:01 user nova-compute[71063]:       <pages unit='KiB' size='4'/>
Apr 11 16:59:01 user nova-compute[71063]:       <pages unit='KiB' size='2048'/>
Apr 11 16:59:01 user nova-compute[71063]:     </cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <power_management>
Apr 11 16:59:01 user nova-compute[71063]:       <suspend_mem/>
Apr 11 16:59:01 user nova-compute[71063]:       <suspend_disk/>
Apr 11 16:59:01 user nova-compute[71063]:       <suspend_hybrid/>
Apr 11 16:59:01 user nova-compute[71063]:     </power_management>
Apr 11 16:59:01 user nova-compute[71063]:     <iommu support='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <migration_features>
Apr 11 16:59:01 user nova-compute[71063]:       <live/>
Apr 11 16:59:01 user nova-compute[71063]:       <uri_transports>
Apr 11 16:59:01 user nova-compute[71063]:         <uri_transport>tcp</uri_transport>
Apr 11 16:59:01 user nova-compute[71063]:         <uri_transport>rdma</uri_transport>
Apr 11 16:59:01 user nova-compute[71063]:       </uri_transports>
Apr 11 16:59:01 user nova-compute[71063]:     </migration_features>
Apr 11 16:59:01 user nova-compute[71063]:     <topology>
Apr 11 16:59:01 user nova-compute[71063]:       <cells num='2'>
Apr 11 16:59:01 user nova-compute[71063]:         <cell id='0'>
Apr 11 16:59:01 user nova-compute[71063]:           <memory unit='KiB'>8189224</memory>
Apr 11 16:59:01 user nova-compute[71063]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 11 16:59:01 user nova-compute[71063]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 16:59:01 user nova-compute[71063]:           <distances>
Apr 11 16:59:01 user nova-compute[71063]:             <sibling id='0' value='10'/>
Apr 11 16:59:01 user nova-compute[71063]:             <sibling id='1' value='20'/>
Apr 11 16:59:01 user nova-compute[71063]:           </distances>
Apr 11 16:59:01 user nova-compute[71063]:           <cpus num='6'>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 16:59:01 user nova-compute[71063]:           </cpus>
Apr 11 16:59:01 user nova-compute[71063]:         </cell>
Apr 11 16:59:01 user nova-compute[71063]:         <cell id='1'>
Apr 11 16:59:01 user nova-compute[71063]:           <memory unit='KiB'>8218764</memory>
Apr 11 16:59:01 user nova-compute[71063]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 11 16:59:01 user nova-compute[71063]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 16:59:01 user nova-compute[71063]:           <distances>
Apr 11 16:59:01 user nova-compute[71063]:             <sibling id='0' value='20'/>
Apr 11 16:59:01 user nova-compute[71063]:             <sibling id='1' value='10'/>
Apr 11 16:59:01 user nova-compute[71063]:           </distances>
Apr 11 16:59:01 user nova-compute[71063]:           <cpus num='6'>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 16:59:01 user nova-compute[71063]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 16:59:01 user nova-compute[71063]:           </cpus>
Apr 11 16:59:01 user nova-compute[71063]:         </cell>
Apr 11 16:59:01 user nova-compute[71063]:       </cells>
Apr 11 16:59:01 user nova-compute[71063]:     </topology>
Apr 11 16:59:01 user nova-compute[71063]:     <cache>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 16:59:01 user nova-compute[71063]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 16:59:01 user nova-compute[71063]:     </cache>
Apr 11 16:59:01 user nova-compute[71063]:     <secmodel>
Apr 11 16:59:01 user nova-compute[71063]:       <model>apparmor</model>
Apr 11 16:59:01 user nova-compute[71063]:       <doi>0</doi>
Apr 11 16:59:01 user nova-compute[71063]:     </secmodel>
Apr 11 16:59:01 user nova-compute[71063]:     <secmodel>
Apr 11 16:59:01 user nova-compute[71063]:       <model>dac</model>
Apr 11 16:59:01 user nova-compute[71063]:       <doi>0</doi>
Apr 11 16:59:01 user nova-compute[71063]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 16:59:01 user nova-compute[71063]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 16:59:01 user nova-compute[71063]:     </secmodel>
Apr 11 16:59:01 user nova-compute[71063]:   </host>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='alpha'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>clipper</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='armv6l'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>spitz</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>nuri</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>kzm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>z2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>tosa</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n810</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>terrier</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>midway</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>microbit</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>verdex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>highbank</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>akita</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>connex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>collie</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='armv7l'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>spitz</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>nuri</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>kzm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>z2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>tosa</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n810</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>terrier</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>midway</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>microbit</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>verdex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>highbank</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>akita</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>connex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>collie</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='aarch64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>spitz</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>nuri</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>kzm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>z2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>tosa</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n810</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>n800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>terrier</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>midway</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>microbit</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>verdex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>highbank</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>akita</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>connex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>collie</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <acpi default='on' toggle='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='cris'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='i686'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>isapc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>microvm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='kvm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <pae/>
Apr 11 16:59:01 user nova-compute[71063]:       <nonpae/>
Apr 11 16:59:01 user nova-compute[71063]:       <acpi default='on' toggle='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:       <apic default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='m68k'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>an5206</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>q800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='microblaze'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='microblazeel'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='mips'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>malta</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='mipsel'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>malta</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='mips64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>malta</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>pica61</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>magnum</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='mips64el'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>malta</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>pica61</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>magnum</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='16'>boston</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='ppc'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mac99</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>40p</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>taihu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='ppc64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>taihu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>40p</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mac99</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='ppc64le'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>taihu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>40p</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>mac99</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='riscv32'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='8'>spike</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='8'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='riscv64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='8'>spike</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='8'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='s390x'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='sh4'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>shix</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>r2d</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='sh4eb'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>shix</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>r2d</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='sparc'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>LX</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='sparc64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>niagara</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='x86_64'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>64</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='1'>isapc</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>microvm</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='kvm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <acpi default='on' toggle='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:       <apic default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='xtensa'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>sim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>kc705</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ml605</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx200</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx60</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]:   <guest>
Apr 11 16:59:01 user nova-compute[71063]:     <os_type>hvm</os_type>
Apr 11 16:59:01 user nova-compute[71063]:     <arch name='xtensaeb'>
Apr 11 16:59:01 user nova-compute[71063]:       <wordsize>32</wordsize>
Apr 11 16:59:01 user nova-compute[71063]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='4'>sim</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>kc705</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ml605</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>virt</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx200</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>lx60</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 16:59:01 user nova-compute[71063]:       <domain type='qemu'/>
Apr 11 16:59:01 user nova-compute[71063]:     </arch>
Apr 11 16:59:01 user nova-compute[71063]:     <features>
Apr 11 16:59:01 user nova-compute[71063]:       <cpuselection/>
Apr 11 16:59:01 user nova-compute[71063]:       <deviceboot/>
Apr 11 16:59:01 user nova-compute[71063]:       <disksnapshot default='on' toggle='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     </features>
Apr 11 16:59:01 user nova-compute[71063]:   </guest>
Apr 11 16:59:01 user nova-compute[71063]: </capabilities>
Apr 11 16:59:01 user nova-compute[71063]: 
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-i440fx-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>i686</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='255'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'/>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='lm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ide</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-i440fx-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>i686</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='255'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'/>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='lm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ide</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-q35-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>i686</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='288'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'/>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='lm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-q35-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>i686</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='288'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'/>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='lm'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-i440fx-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>x86_64</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='255'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>efi</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='invtsc'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='rsba'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ide</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-i440fx-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>x86_64</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='255'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>efi</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='invtsc'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='rsba'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ide</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-q35-jammy</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>x86_64</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='288'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>efi</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='invtsc'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='rsba'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 16:59:01 user nova-compute[71063]: <domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 16:59:01 user nova-compute[71063]:   <domain>kvm</domain>
Apr 11 16:59:01 user nova-compute[71063]:   <machine>pc-q35-6.2</machine>
Apr 11 16:59:01 user nova-compute[71063]:   <arch>x86_64</arch>
Apr 11 16:59:01 user nova-compute[71063]:   <vcpu max='288'/>
Apr 11 16:59:01 user nova-compute[71063]:   <iothreads supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:   <os supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='firmware'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>efi</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:     <loader supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>rom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pflash</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='readonly'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='secure'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>yes</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>no</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </loader>
Apr 11 16:59:01 user nova-compute[71063]:   </os>
Apr 11 16:59:01 user nova-compute[71063]:   <cpu>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-passthrough' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='hostPassthroughMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='maximum' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='maximumMigratable'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>on</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>off</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='host-model' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <vendor>Intel</vendor>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ss'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='vmx'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pcid'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='hypervisor'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arat'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='umip'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='md-clear'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='invtsc'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibpb'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='ibrs'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-stibp'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='rsba'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='erms'/>
Apr 11 16:59:01 user nova-compute[71063]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:     <mode name='custom' supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>qemu64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>qemu32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>phenom</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>pentium</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>n270</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm64</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>kvm32</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>coreduo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>core2duo</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>athlon</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Westmere</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Snowridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Skylake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>SandyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Penryn</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G5</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G4</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G3</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Opteron_G2</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Opteron_G1</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>IvyBridge</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Icelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Haswell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Rome</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-Milan</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>EPYC</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Dhyana</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cooperlake</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>Conroe</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='no'>Broadwell</model>
Apr 11 16:59:01 user nova-compute[71063]:       <model usable='yes'>486</model>
Apr 11 16:59:01 user nova-compute[71063]:     </mode>
Apr 11 16:59:01 user nova-compute[71063]:   </cpu>
Apr 11 16:59:01 user nova-compute[71063]:   <memoryBacking supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:     <enum name='sourceType'>
Apr 11 16:59:01 user nova-compute[71063]:       <value>file</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>anonymous</value>
Apr 11 16:59:01 user nova-compute[71063]:       <value>memfd</value>
Apr 11 16:59:01 user nova-compute[71063]:     </enum>
Apr 11 16:59:01 user nova-compute[71063]:   </memoryBacking>
Apr 11 16:59:01 user nova-compute[71063]:   <devices>
Apr 11 16:59:01 user nova-compute[71063]:     <disk supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='diskDevice'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>disk</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cdrom</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>floppy</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>lun</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='bus'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>fdc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sata</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </disk>
Apr 11 16:59:01 user nova-compute[71063]:     <graphics supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='type'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>sdl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vnc</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>spice</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egl-headless</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </graphics>
Apr 11 16:59:01 user nova-compute[71063]:     <video supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='modelType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>cirrus</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>vmvga</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>qxl</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>none</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>bochs</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>ramfb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </video>
Apr 11 16:59:01 user nova-compute[71063]:     <hostdev supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='mode'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>subsystem</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='startupPolicy'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>default</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>mandatory</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>requisite</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>optional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='subsysType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>usb</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>pci</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>scsi</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='capsType'/>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='pciBackend'/>
Apr 11 16:59:01 user nova-compute[71063]:     </hostdev>
Apr 11 16:59:01 user nova-compute[71063]:     <rng supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtio-non-transitional</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>random</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>egd</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>builtin</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </rng>
Apr 11 16:59:01 user nova-compute[71063]:     <filesystem supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='driverType'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>path</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>handle</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>virtiofs</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </filesystem>
Apr 11 16:59:01 user nova-compute[71063]:     <tpm supported='yes'>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='model'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-tis</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>tpm-crb</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:       <enum name='backendModel'>
Apr 11 16:59:01 user nova-compute[71063]:         <value>passthrough</value>
Apr 11 16:59:01 user nova-compute[71063]:         <value>emulator</value>
Apr 11 16:59:01 user nova-compute[71063]:       </enum>
Apr 11 16:59:01 user nova-compute[71063]:     </tpm>
Apr 11 16:59:01 user nova-compute[71063]:   </devices>
Apr 11 16:59:01 user nova-compute[71063]:   <features>
Apr 11 16:59:01 user nova-compute[71063]:     <gic supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:     <vmcoreinfo supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <genid supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backingStoreInput supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <backup supported='yes'/>
Apr 11 16:59:01 user nova-compute[71063]:     <sev supported='no'/>
Apr 11 16:59:01 user nova-compute[71063]:   </features>
Apr 11 16:59:01 user nova-compute[71063]: </domainCapabilities>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71063) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71063) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Checking secure boot support for host arch (x86_64) {{(pid=71063) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Checking secure boot support for host arch (x86_64) {{(pid=71063) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Checking secure boot support for host arch (x86_64) {{(pid=71063) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Checking secure boot support for host arch (x86_64) {{(pid=71063) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Checking secure boot support for host arch (x86_64) {{(pid=71063) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Secure Boot support detected
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] cpu compare xml: <cpu match="exact">
Apr 11 16:59:01 user nova-compute[71063]:   <model>Nehalem</model>
Apr 11 16:59:01 user nova-compute[71063]: </cpu>
Apr 11 16:59:01 user nova-compute[71063]:  {{(pid=71063) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.virt.node [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Generated node identity 5e60710e-bd05-42a7-9d8e-dda73c9154fd
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.virt.node [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Wrote node identity 5e60710e-bd05-42a7-9d8e-dda73c9154fd to /opt/stack/data/nova/compute_id
Apr 11 16:59:01 user nova-compute[71063]: WARNING nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Compute nodes ['5e60710e-bd05-42a7-9d8e-dda73c9154fd'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 16:59:01 user nova-compute[71063]: WARNING nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 16:59:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:59:01 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:59:01 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Hypervisor/Node resource view: name=user free_ram=10903MB free_disk=27.21369171142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:59:01 user nova-compute[71063]: WARNING nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] No compute node record for user:5e60710e-bd05-42a7-9d8e-dda73c9154fd: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5e60710e-bd05-42a7-9d8e-dda73c9154fd could not be found.
Apr 11 16:59:01 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Compute node record created for user:user with uuid: 5e60710e-bd05-42a7-9d8e-dda73c9154fd
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:59:01 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:59:02 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [req-f685c6bc-45c5-4e81-9a7e-787d06dcbc32] Created resource provider record via placement API for resource provider with UUID 5e60710e-bd05-42a7-9d8e-dda73c9154fd and name user.
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71063) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 16:59:02 user nova-compute[71063]: INFO nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] kernel doesn't support AMD SEV
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Libvirt baseline CPU <cpu>
Apr 11 16:59:02 user nova-compute[71063]:   <arch>x86_64</arch>
Apr 11 16:59:02 user nova-compute[71063]:   <model>Nehalem</model>
Apr 11 16:59:02 user nova-compute[71063]:   <vendor>Intel</vendor>
Apr 11 16:59:02 user nova-compute[71063]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 16:59:02 user nova-compute[71063]: </cpu>
Apr 11 16:59:02 user nova-compute[71063]:  {{(pid=71063) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Updated inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Updating resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd generation from 0 to 1 during operation: update_inventory {{(pid=71063) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Updating resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd generation from 1 to 2 during operation: update_traits {{(pid=71063) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.service [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Creating RPC server for service compute {{(pid=71063) start /opt/stack/nova/nova/service.py:182}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.service [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Join ServiceGroup membership for this service compute {{(pid=71063) start /opt/stack/nova/nova/service.py:199}}
Apr 11 16:59:02 user nova-compute[71063]: DEBUG nova.servicegroup.drivers.db [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71063) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 16:59:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 16:59:53 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:59:53 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=10270MB free_disk=27.127487182617188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 16:59:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:00:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:00:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:00:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=10200MB free_disk=27.171428680419922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:00:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.099s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:01:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:01:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:56 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:01:57 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:01:57 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=10165MB free_disk=26.94953155517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:01:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:02:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:02:56 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:02:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:02:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:02:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:02:58 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:02:58 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=9447MB free_disk=26.971981048583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:02:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:07 user nova-compute[71063]: INFO nova.compute.claims [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Claim successful on node user
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Creating image(s)
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.policy [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.part --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.virt.images [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] ead60aec-ecbe-42c9-a205-fb6fdd4aef73 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.part /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:08 user nova-compute[71063]: INFO nova.compute.claims [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Claim successful on node user
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.part /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.converted" returned: 0 in 0.125s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054.converted --force-share --output=json" returned: 0 in 0.126s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.968s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:08 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4xgybcqs/privsep.sock']
Apr 11 17:03:08 user sudo[79796]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4xgybcqs/privsep.sock
Apr 11 17:03:08 user sudo[79796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Creating image(s)
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:09 user nova-compute[71063]: INFO nova.compute.claims [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Claim successful on node user
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.policy [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Creating image(s)
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG nova.policy [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:10 user sudo[79796]: pam_unix(sudo:session): session closed for user root
Apr 11 17:03:10 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Spawned new privsep daemon via rootwrap
Apr 11 17:03:10 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 17:03:10 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 17:03:10 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 17:03:10 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79805
Apr 11 17:03:10 user nova-compute[71063]: WARNING oslo_privsep.priv_context [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] privsep daemon already running
Apr 11 17:03:10 user nova-compute[71063]: WARNING oslo_privsep.priv_context [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] privsep daemon already running
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.123s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.123s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk 1073741824" returned: 0 in 0.053s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.171s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.113s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk 1073741824" returned: 0 in 0.045s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.368s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Cannot resize image /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Ensure instance console log exists: /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk 1073741824" returned: 0 in 0.044s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Cannot resize image /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'migration_context' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Ensure instance console log exists: /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:11 user nova-compute[71063]: INFO nova.compute.claims [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Claim successful on node user
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Cannot resize image /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Ensure instance console log exists: /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating image(s)
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:12 user nova-compute[71063]: INFO nova.compute.claims [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Claim successful on node user
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk 1073741824" returned: 0 in 0.047s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.policy [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'migration_context' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Creating image(s)
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "/opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "/opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "/opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Successfully created port: b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.128s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.policy [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c74611f9b01a45ef8cfbb50fa9b06cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0fe3df39a64a39934d199c01985777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk 1073741824" returned: 0 in 0.186s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.123s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Cannot resize image /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lazy-loading 'migration_context' on Instance uuid 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Ensure instance console log exists: /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:14 user nova-compute[71063]: INFO nova.compute.claims [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Claim successful on node user
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Successfully created port: 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Successfully created port: 153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:14 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:14 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Creating image(s)
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "/opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.policy [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk 1073741824" returned: 0 in 0.050s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Cannot resize image /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'migration_context' on Instance uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Ensure instance console log exists: /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Successfully created port: 6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Successfully created port: 5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Successfully created port: f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Successfully updated port: 153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Successfully updated port: b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-changed-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Refreshing instance network info cache due to event network-changed-153bd902-5486-49d7-8f56-9ac648664124. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-changed-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Refreshing instance network info cache due to event network-changed-b26876bb-0ee7-42f8-a592-b9078cd9701a. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance network_info: |[{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Refreshing network info cache for port 153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start _get_guest_xml network_info=[{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:18 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:18 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242455481',display_name='tempest-ServerRescueNegativeTestJSON-server-1242455481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242455481',id=3,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-ia8pkgh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:10Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=58e3bca8-f38a-45d1-98c2-06391f9f31fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:18 user nova-compute[71063]:   <uuid>58e3bca8-f38a-45d1-98c2-06391f9f31fd</uuid>
Apr 11 17:03:18 user nova-compute[71063]:   <name>instance-00000003</name>
Apr 11 17:03:18 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:18 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:18 user nova-compute[71063]:   <metadata>
Apr 11 17:03:18 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:18 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1242455481</nova:name>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:18</nova:creationTime>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:18 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:18 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:03:18 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:18 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:18 user nova-compute[71063]:         <nova:port uuid="153bd902-5486-49d7-8f56-9ac648664124">
Apr 11 17:03:18 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 17:03:18 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:18 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:18 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:18 user nova-compute[71063]:   </metadata>
Apr 11 17:03:18 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:18 user nova-compute[71063]:     <system>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="serial">58e3bca8-f38a-45d1-98c2-06391f9f31fd</entry>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="uuid">58e3bca8-f38a-45d1-98c2-06391f9f31fd</entry>
Apr 11 17:03:18 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:18 user nova-compute[71063]:     </system>
Apr 11 17:03:18 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:18 user nova-compute[71063]:   <os>
Apr 11 17:03:18 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:18 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:18 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:18 user nova-compute[71063]:   </os>
Apr 11 17:03:18 user nova-compute[71063]:   <features>
Apr 11 17:03:18 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:18 user nova-compute[71063]:     <apic/>
Apr 11 17:03:18 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:18 user nova-compute[71063]:   </features>
Apr 11 17:03:18 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:18 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:18 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:18 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:18 user nova-compute[71063]:   </clock>
Apr 11 17:03:18 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:18 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:18 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:18 user nova-compute[71063]:   </cpu>
Apr 11 17:03:18 user nova-compute[71063]:   <devices>
Apr 11 17:03:18 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:18 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:18 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk"/>
Apr 11 17:03:18 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:18 user nova-compute[71063]:     </disk>
Apr 11 17:03:18 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:18 user nova-compute[71063]:       <mac address="fa:16:3e:0d:c9:1a"/>
Apr 11 17:03:18 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:18 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:18 user nova-compute[71063]:       <target dev="tap153bd902-54"/>
Apr 11 17:03:18 user nova-compute[71063]:     </interface>
Apr 11 17:03:18 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:18 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/console.log" append="off"/>
Apr 11 17:03:18 user nova-compute[71063]:     </serial>
Apr 11 17:03:18 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:18 user nova-compute[71063]:     <video>
Apr 11 17:03:18 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:18 user nova-compute[71063]:     </video>
Apr 11 17:03:18 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:18 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:18 user nova-compute[71063]:     </rng>
Apr 11 17:03:18 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:18 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:18 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:18 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:18 user nova-compute[71063]:   </devices>
Apr 11 17:03:18 user nova-compute[71063]: </domain>
Apr 11 17:03:18 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242455481',display_name='tempest-ServerRescueNegativeTestJSON-server-1242455481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242455481',id=3,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-ia8pkgh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:10Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=58e3bca8-f38a-45d1-98c2-06391f9f31fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG os_vif [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Created schema index Interface.name {{(pid=71063) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Created schema index Port.name {{(pid=71063) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Created schema index Bridge.name {{(pid=71063) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [POLLOUT] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:18 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpb7ok1kug/privsep.sock']
Apr 11 17:03:18 user sudo[79904]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpb7ok1kug/privsep.sock
Apr 11 17:03:18 user sudo[79904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 17:03:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Successfully updated port: 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance network_info: |[{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Refreshing network info cache for port b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start _get_guest_xml network_info=[{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:19 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:19 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332777263',display_name='tempest-ServerRescueNegativeTestJSON-server-1332777263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1332777263',id=1,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-fu5ob7zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:08Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=25935a69-292b-4d55-932c-f4893838998c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.objects.instance [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:19 user nova-compute[71063]:   <uuid>25935a69-292b-4d55-932c-f4893838998c</uuid>
Apr 11 17:03:19 user nova-compute[71063]:   <name>instance-00000001</name>
Apr 11 17:03:19 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:19 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:19 user nova-compute[71063]:   <metadata>
Apr 11 17:03:19 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:19 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1332777263</nova:name>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:19</nova:creationTime>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:19 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:19 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:03:19 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:19 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:19 user nova-compute[71063]:         <nova:port uuid="b26876bb-0ee7-42f8-a592-b9078cd9701a">
Apr 11 17:03:19 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 17:03:19 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:19 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:19 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:19 user nova-compute[71063]:   </metadata>
Apr 11 17:03:19 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:19 user nova-compute[71063]:     <system>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="serial">25935a69-292b-4d55-932c-f4893838998c</entry>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="uuid">25935a69-292b-4d55-932c-f4893838998c</entry>
Apr 11 17:03:19 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:19 user nova-compute[71063]:     </system>
Apr 11 17:03:19 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:19 user nova-compute[71063]:   <os>
Apr 11 17:03:19 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:19 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:19 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:19 user nova-compute[71063]:   </os>
Apr 11 17:03:19 user nova-compute[71063]:   <features>
Apr 11 17:03:19 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:19 user nova-compute[71063]:     <apic/>
Apr 11 17:03:19 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:19 user nova-compute[71063]:   </features>
Apr 11 17:03:19 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:19 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:19 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:19 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:19 user nova-compute[71063]:   </clock>
Apr 11 17:03:19 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:19 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:19 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:19 user nova-compute[71063]:   </cpu>
Apr 11 17:03:19 user nova-compute[71063]:   <devices>
Apr 11 17:03:19 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:19 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:19 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk"/>
Apr 11 17:03:19 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:19 user nova-compute[71063]:     </disk>
Apr 11 17:03:19 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:19 user nova-compute[71063]:       <mac address="fa:16:3e:d7:35:9d"/>
Apr 11 17:03:19 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:19 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:19 user nova-compute[71063]:       <target dev="tapb26876bb-0e"/>
Apr 11 17:03:19 user nova-compute[71063]:     </interface>
Apr 11 17:03:19 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:19 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/console.log" append="off"/>
Apr 11 17:03:19 user nova-compute[71063]:     </serial>
Apr 11 17:03:19 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:19 user nova-compute[71063]:     <video>
Apr 11 17:03:19 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:19 user nova-compute[71063]:     </video>
Apr 11 17:03:19 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:19 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:19 user nova-compute[71063]:     </rng>
Apr 11 17:03:19 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:19 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:19 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:19 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:19 user nova-compute[71063]:   </devices>
Apr 11 17:03:19 user nova-compute[71063]: </domain>
Apr 11 17:03:19 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332777263',display_name='tempest-ServerRescueNegativeTestJSON-server-1332777263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1332777263',id=1,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-fu5ob7zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:08Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=25935a69-292b-4d55-932c-f4893838998c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG os_vif [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updated VIF entry in instance network info cache for port 153bd902-5486-49d7-8f56-9ac648664124. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-changed-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing instance network info cache due to event network-changed-34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:20 user sudo[79904]: pam_unix(sudo:session): session closed for user root
Apr 11 17:03:20 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Spawned new privsep daemon via rootwrap
Apr 11 17:03:20 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 17:03:20 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 17:03:20 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 17:03:20 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 79908
Apr 11 17:03:20 user nova-compute[71063]: WARNING oslo_privsep.priv_context [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] privsep daemon already running
Apr 11 17:03:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Successfully updated port: f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-changed-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Refreshing instance network info cache due to event network-changed-f4ebd413-5243-4c27-8dc3-91a5991d3ecf. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb26876bb-0e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb26876bb-0e, col_values=(('external_ids', {'iface-id': 'b26876bb-0ee7-42f8-a592-b9078cd9701a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:35:9d', 'vm-uuid': '25935a69-292b-4d55-932c-f4893838998c'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap153bd902-54, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap153bd902-54, col_values=(('external_ids', {'iface-id': '153bd902-5486-49d7-8f56-9ac648664124', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:c9:1a', 'vm-uuid': '58e3bca8-f38a-45d1-98c2-06391f9f31fd'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: INFO os_vif [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e')
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: INFO os_vif [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54')
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:d7:35:9d, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:0d:c9:1a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance network_info: |[{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing network info cache for port 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start _get_guest_xml network_info=[{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:21 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:21 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-296076626',display_name='tempest-ServerStableDeviceRescueTest-server-296076626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-296076626',id=2,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL7i/fp+DnNA0UzB89OuJAWEkDI3RLIMqdCUH+lLMjesQHNn0HLcj03mslu5ZdYDA0lbw8n78DIaEgXcMzFJM3/kIURu2fRqfoahFiI9aLfMiPTgBrcusJmx/nC+OKLjg==',key_name='tempest-keypair-1584212675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b803e7cf929440298b14cd3177c96e8',ramdisk_id='',reservation_id='r-15wgi8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1699560884',owner_user_name='tempest-ServerStableDeviceRescueTest-1699560884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6126b468bd2414d831b105a3429ddd1',uuid=17f03f63-a491-4fd4-a282-a4e9b5b6aa2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converting VIF {"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'pci_devices' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:21 user nova-compute[71063]:   <uuid>17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</uuid>
Apr 11 17:03:21 user nova-compute[71063]:   <name>instance-00000002</name>
Apr 11 17:03:21 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:21 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:21 user nova-compute[71063]:   <metadata>
Apr 11 17:03:21 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:21 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-296076626</nova:name>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:21</nova:creationTime>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:21 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:21 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:user uuid="c6126b468bd2414d831b105a3429ddd1">tempest-ServerStableDeviceRescueTest-1699560884-project-member</nova:user>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:project uuid="9b803e7cf929440298b14cd3177c96e8">tempest-ServerStableDeviceRescueTest-1699560884</nova:project>
Apr 11 17:03:21 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:21 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:21 user nova-compute[71063]:         <nova:port uuid="34535545-332f-47ea-b110-74b5f957388e">
Apr 11 17:03:21 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:03:21 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:21 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:21 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:21 user nova-compute[71063]:   </metadata>
Apr 11 17:03:21 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:21 user nova-compute[71063]:     <system>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="serial">17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</entry>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="uuid">17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</entry>
Apr 11 17:03:21 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:21 user nova-compute[71063]:     </system>
Apr 11 17:03:21 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:21 user nova-compute[71063]:   <os>
Apr 11 17:03:21 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:21 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:21 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:21 user nova-compute[71063]:   </os>
Apr 11 17:03:21 user nova-compute[71063]:   <features>
Apr 11 17:03:21 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:21 user nova-compute[71063]:     <apic/>
Apr 11 17:03:21 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:21 user nova-compute[71063]:   </features>
Apr 11 17:03:21 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:21 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:21 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:21 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:21 user nova-compute[71063]:   </clock>
Apr 11 17:03:21 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:21 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:21 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:21 user nova-compute[71063]:   </cpu>
Apr 11 17:03:21 user nova-compute[71063]:   <devices>
Apr 11 17:03:21 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:21 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:21 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk"/>
Apr 11 17:03:21 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:21 user nova-compute[71063]:     </disk>
Apr 11 17:03:21 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:21 user nova-compute[71063]:       <mac address="fa:16:3e:70:63:7b"/>
Apr 11 17:03:21 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:21 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:21 user nova-compute[71063]:       <target dev="tap34535545-33"/>
Apr 11 17:03:21 user nova-compute[71063]:     </interface>
Apr 11 17:03:21 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:21 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/console.log" append="off"/>
Apr 11 17:03:21 user nova-compute[71063]:     </serial>
Apr 11 17:03:21 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:21 user nova-compute[71063]:     <video>
Apr 11 17:03:21 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:21 user nova-compute[71063]:     </video>
Apr 11 17:03:21 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:21 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:21 user nova-compute[71063]:     </rng>
Apr 11 17:03:21 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:21 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:21 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:21 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:21 user nova-compute[71063]:   </devices>
Apr 11 17:03:21 user nova-compute[71063]: </domain>
Apr 11 17:03:21 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-296076626',display_name='tempest-ServerStableDeviceRescueTest-server-296076626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-296076626',id=2,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL7i/fp+DnNA0UzB89OuJAWEkDI3RLIMqdCUH+lLMjesQHNn0HLcj03mslu5ZdYDA0lbw8n78DIaEgXcMzFJM3/kIURu2fRqfoahFiI9aLfMiPTgBrcusJmx/nC+OKLjg==',key_name='tempest-keypair-1584212675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b803e7cf929440298b14cd3177c96e8',ramdisk_id='',reservation_id='r-15wgi8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1699560884',owner_user_name='tempest-ServerStableDeviceRescueTest-1699560884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6126b468bd2414d831b105a3429ddd1',uuid=17f03f63-a491-4fd4-a282-a4e9b5b6aa2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converting VIF {"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG os_vif [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34535545-33, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34535545-33, col_values=(('external_ids', {'iface-id': '34535545-332f-47ea-b110-74b5f957388e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:63:7b', 'vm-uuid': '17f03f63-a491-4fd4-a282-a4e9b5b6aa2e'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:21 user nova-compute[71063]: INFO nova.compute.claims [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Claim successful on node user
Apr 11 17:03:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:21 user nova-compute[71063]: INFO os_vif [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33')
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No VIF found with MAC fa:16:3e:70:63:7b, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Successfully updated port: 5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquired lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.policy [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Creating image(s)
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updated VIF entry in instance network info cache for port b26876bb-0ee7-42f8-a592-b9078cd9701a. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Successfully updated port: 6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.187s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk 1073741824" returned: 0 in 0.055s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-changed-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Refreshing instance network info cache due to event network-changed-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Acquiring lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.186s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Instance network_info: |[{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Refreshing network info cache for port f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Start _get_guest_xml network_info=[{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Cannot resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.objects.instance [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'migration_context' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Ensure instance console log exists: /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1883237379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1883237379',id=6,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-79wkmbbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:15Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=05988541-51cb-4e52-912e-ddf2b773db6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:22 user nova-compute[71063]:   <uuid>05988541-51cb-4e52-912e-ddf2b773db6b</uuid>
Apr 11 17:03:22 user nova-compute[71063]:   <name>instance-00000006</name>
Apr 11 17:03:22 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:22 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:22 user nova-compute[71063]:   <metadata>
Apr 11 17:03:22 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:22 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1883237379</nova:name>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:22</nova:creationTime>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:22 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:22 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:03:22 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:22 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:22 user nova-compute[71063]:         <nova:port uuid="f4ebd413-5243-4c27-8dc3-91a5991d3ecf">
Apr 11 17:03:22 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 17:03:22 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:22 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:22 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:22 user nova-compute[71063]:   </metadata>
Apr 11 17:03:22 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:22 user nova-compute[71063]:     <system>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="serial">05988541-51cb-4e52-912e-ddf2b773db6b</entry>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="uuid">05988541-51cb-4e52-912e-ddf2b773db6b</entry>
Apr 11 17:03:22 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:22 user nova-compute[71063]:     </system>
Apr 11 17:03:22 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:22 user nova-compute[71063]:   <os>
Apr 11 17:03:22 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:22 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:22 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:22 user nova-compute[71063]:   </os>
Apr 11 17:03:22 user nova-compute[71063]:   <features>
Apr 11 17:03:22 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:22 user nova-compute[71063]:     <apic/>
Apr 11 17:03:22 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:22 user nova-compute[71063]:   </features>
Apr 11 17:03:22 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:22 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:22 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:22 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:22 user nova-compute[71063]:   </clock>
Apr 11 17:03:22 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:22 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:22 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:22 user nova-compute[71063]:   </cpu>
Apr 11 17:03:22 user nova-compute[71063]:   <devices>
Apr 11 17:03:22 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:22 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:22 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk"/>
Apr 11 17:03:22 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:22 user nova-compute[71063]:     </disk>
Apr 11 17:03:22 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:22 user nova-compute[71063]:       <mac address="fa:16:3e:15:a8:b1"/>
Apr 11 17:03:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:22 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:22 user nova-compute[71063]:       <target dev="tapf4ebd413-52"/>
Apr 11 17:03:22 user nova-compute[71063]:     </interface>
Apr 11 17:03:22 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:22 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/console.log" append="off"/>
Apr 11 17:03:22 user nova-compute[71063]:     </serial>
Apr 11 17:03:22 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:22 user nova-compute[71063]:     <video>
Apr 11 17:03:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:22 user nova-compute[71063]:     </video>
Apr 11 17:03:22 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:22 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:22 user nova-compute[71063]:     </rng>
Apr 11 17:03:22 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:22 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:22 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:22 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:22 user nova-compute[71063]:   </devices>
Apr 11 17:03:22 user nova-compute[71063]: </domain>
Apr 11 17:03:22 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1883237379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1883237379',id=6,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-79wkmbbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:15Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=05988541-51cb-4e52-912e-ddf2b773db6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG os_vif [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4ebd413-52, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4ebd413-52, col_values=(('external_ids', {'iface-id': 'f4ebd413-5243-4c27-8dc3-91a5991d3ecf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:a8:b1', 'vm-uuid': '05988541-51cb-4e52-912e-ddf2b773db6b'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:22 user nova-compute[71063]: INFO os_vif [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52')
Apr 11 17:03:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:15:a8:b1, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updated VIF entry in instance network info cache for port 34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Updating instance_info_cache with network_info: [{"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Releasing lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Instance network_info: |[{"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Acquired lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Refreshing network info cache for port 5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Start _get_guest_xml network_info=[{"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:23 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:23 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1282492333',display_name='tempest-DeleteServersTestJSON-server-1282492333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1282492333',id=5,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e0fe3df39a64a39934d199c01985777',ramdisk_id='',reservation_id='r-a12k56eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1700911607',owner_user_name='tempest-DeleteServersTestJSON-1700911607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:13Z,user_data=None,user_id='c74611f9b01a45ef8cfbb50fa9b06cc8',uuid=6687cdc1-6ab3-4e6d-b4a4-e03772606c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converting VIF {"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lazy-loading 'pci_devices' on Instance uuid 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:23 user nova-compute[71063]:   <uuid>6687cdc1-6ab3-4e6d-b4a4-e03772606c41</uuid>
Apr 11 17:03:23 user nova-compute[71063]:   <name>instance-00000005</name>
Apr 11 17:03:23 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:23 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:23 user nova-compute[71063]:   <metadata>
Apr 11 17:03:23 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:23 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:name>tempest-DeleteServersTestJSON-server-1282492333</nova:name>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:23</nova:creationTime>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:23 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:23 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:user uuid="c74611f9b01a45ef8cfbb50fa9b06cc8">tempest-DeleteServersTestJSON-1700911607-project-member</nova:user>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:project uuid="9e0fe3df39a64a39934d199c01985777">tempest-DeleteServersTestJSON-1700911607</nova:project>
Apr 11 17:03:23 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:23 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:23 user nova-compute[71063]:         <nova:port uuid="5b56bc1c-c00c-4398-ad90-9dc3b8c71f20">
Apr 11 17:03:23 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 17:03:23 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:23 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:23 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:23 user nova-compute[71063]:   </metadata>
Apr 11 17:03:23 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:23 user nova-compute[71063]:     <system>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="serial">6687cdc1-6ab3-4e6d-b4a4-e03772606c41</entry>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="uuid">6687cdc1-6ab3-4e6d-b4a4-e03772606c41</entry>
Apr 11 17:03:23 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:23 user nova-compute[71063]:     </system>
Apr 11 17:03:23 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:23 user nova-compute[71063]:   <os>
Apr 11 17:03:23 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:23 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:23 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:23 user nova-compute[71063]:   </os>
Apr 11 17:03:23 user nova-compute[71063]:   <features>
Apr 11 17:03:23 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:23 user nova-compute[71063]:     <apic/>
Apr 11 17:03:23 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:23 user nova-compute[71063]:   </features>
Apr 11 17:03:23 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:23 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:23 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:23 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:23 user nova-compute[71063]:   </clock>
Apr 11 17:03:23 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:23 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:23 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:23 user nova-compute[71063]:   </cpu>
Apr 11 17:03:23 user nova-compute[71063]:   <devices>
Apr 11 17:03:23 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:23 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:23 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk"/>
Apr 11 17:03:23 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:23 user nova-compute[71063]:     </disk>
Apr 11 17:03:23 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:23 user nova-compute[71063]:       <mac address="fa:16:3e:c4:96:0a"/>
Apr 11 17:03:23 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:23 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:23 user nova-compute[71063]:       <target dev="tap5b56bc1c-c0"/>
Apr 11 17:03:23 user nova-compute[71063]:     </interface>
Apr 11 17:03:23 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:23 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/console.log" append="off"/>
Apr 11 17:03:23 user nova-compute[71063]:     </serial>
Apr 11 17:03:23 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:23 user nova-compute[71063]:     <video>
Apr 11 17:03:23 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:23 user nova-compute[71063]:     </video>
Apr 11 17:03:23 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:23 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:23 user nova-compute[71063]:     </rng>
Apr 11 17:03:23 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:23 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:23 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:23 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:23 user nova-compute[71063]:   </devices>
Apr 11 17:03:23 user nova-compute[71063]: </domain>
Apr 11 17:03:23 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1282492333',display_name='tempest-DeleteServersTestJSON-server-1282492333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1282492333',id=5,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e0fe3df39a64a39934d199c01985777',ramdisk_id='',reservation_id='r-a12k56eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1700911607',owner_user_name='tempest-DeleteServersTestJSON-1700911607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:13Z,user_data=None,user_id='c74611f9b01a45ef8cfbb50fa9b06cc8',uuid=6687cdc1-6ab3-4e6d-b4a4-e03772606c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converting VIF {"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG os_vif [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b56bc1c-c0, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b56bc1c-c0, col_values=(('external_ids', {'iface-id': '5b56bc1c-c00c-4398-ad90-9dc3b8c71f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:96:0a', 'vm-uuid': '6687cdc1-6ab3-4e6d-b4a4-e03772606c41'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:23 user nova-compute[71063]: INFO os_vif [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0')
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Successfully created port: 8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] No VIF found with MAC fa:16:3e:c4:96:0a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance network_info: |[{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start _get_guest_xml network_info=[{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updated VIF entry in instance network info cache for port f4ebd413-5243-4c27-8dc3-91a5991d3ecf. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Updated VIF entry in instance network info cache for port 5b56bc1c-c00c-4398-ad90-9dc3b8c71f20. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Updating instance_info_cache with network_info: [{"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Releasing lock "refresh_cache-6687cdc1-6ab3-4e6d-b4a4-e03772606c41" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-changed-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Refreshing instance network info cache due to event network-changed-6b20a003-d501-4958-9c8c-567343698e97. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Refreshing network info cache for port 6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updated VIF entry in instance network info cache for port 6b20a003-d501-4958-9c8c-567343698e97. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Successfully updated port: 8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-changed-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Refreshing instance network info cache due to event network-changed-8b4b45a7-1e14-4c93-a6a9-fe814512cef2. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance network_info: |[{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Refreshing network info cache for port 8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start _get_guest_xml network_info=[{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:28 user nova-compute[71063]: WARNING nova.compute.manager [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state building and task_state spawning.
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updated VIF entry in instance network info cache for port 8b4b45a7-1e14-4c93-a6a9-fe814512cef2. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] No waiting events found dispatching network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:28 user nova-compute[71063]: WARNING nova.compute.manager [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received unexpected event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance with vm_state building and task_state spawning.
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.compute.manager [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state building and task_state spawning.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.compute.manager [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state building and task_state spawning.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7235231, 25935a69-292b-4d55-932c-f4893838998c => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Resumed (Lifecycle Event)
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.compute.claims [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Claim successful on node user
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance spawned successfully.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance spawned successfully.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance spawned successfully.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Instance spawned successfully.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'pci_devices' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-1483979995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7247322, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Resumed (Lifecycle Event)
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:31 user nova-compute[71063]:   <uuid>d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</uuid>
Apr 11 17:03:31 user nova-compute[71063]:   <name>instance-00000007</name>
Apr 11 17:03:31 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:31 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:31 user nova-compute[71063]:   <metadata>
Apr 11 17:03:31 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:31 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeTestJSON-server-1659221805</nova:name>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:30</nova:creationTime>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:31 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:user uuid="ac0109eab2dc45fe824a03e2d09fa022">tempest-AttachVolumeTestJSON-1071232138-project-member</nova:user>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:project uuid="3c902eb30be24cc6bd26c0ab7036d037">tempest-AttachVolumeTestJSON-1071232138</nova:project>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:port uuid="8b4b45a7-1e14-4c93-a6a9-fe814512cef2">
Apr 11 17:03:31 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:03:31 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:31 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:31 user nova-compute[71063]:   </metadata>
Apr 11 17:03:31 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:31 user nova-compute[71063]:     <system>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="serial">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="uuid">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:31 user nova-compute[71063]:     </system>
Apr 11 17:03:31 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:31 user nova-compute[71063]:   <os>
Apr 11 17:03:31 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:31 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:31 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:31 user nova-compute[71063]:   </os>
Apr 11 17:03:31 user nova-compute[71063]:   <features>
Apr 11 17:03:31 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:31 user nova-compute[71063]:     <apic/>
Apr 11 17:03:31 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:31 user nova-compute[71063]:   </features>
Apr 11 17:03:31 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:31 user nova-compute[71063]:   </clock>
Apr 11 17:03:31 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:31 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:31 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:31 user nova-compute[71063]:   </cpu>
Apr 11 17:03:31 user nova-compute[71063]:   <devices>
Apr 11 17:03:31 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:31 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:31 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk"/>
Apr 11 17:03:31 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:     </disk>
Apr 11 17:03:31 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:31 user nova-compute[71063]:       <mac address="fa:16:3e:42:9e:29"/>
Apr 11 17:03:31 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:31 user nova-compute[71063]:       <target dev="tap8b4b45a7-1e"/>
Apr 11 17:03:31 user nova-compute[71063]:     </interface>
Apr 11 17:03:31 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:31 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/console.log" append="off"/>
Apr 11 17:03:31 user nova-compute[71063]:     </serial>
Apr 11 17:03:31 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:31 user nova-compute[71063]:     <video>
Apr 11 17:03:31 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:     </video>
Apr 11 17:03:31 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:31 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:31 user nova-compute[71063]:     </rng>
Apr 11 17:03:31 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:31 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:31 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:31 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:31 user nova-compute[71063]:   </devices>
Apr 11 17:03:31 user nova-compute[71063]: </domain>
Apr 11 17:03:31 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG os_vif [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] No waiting events found dispatching network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:31 user nova-compute[71063]: WARNING nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received unexpected event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance with vm_state building and task_state spawning.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] No waiting events found dispatching network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:31 user nova-compute[71063]: WARNING nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received unexpected event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance with vm_state building and task_state spawning.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] No waiting events found dispatching network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:31 user nova-compute[71063]: WARNING nova.compute.manager [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received unexpected event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance with vm_state building and task_state spawning.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:31 user nova-compute[71063]:   <uuid>1fc7677c-cbd9-48e7-be62-2210074bc87a</uuid>
Apr 11 17:03:31 user nova-compute[71063]:   <name>instance-00000004</name>
Apr 11 17:03:31 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:31 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:31 user nova-compute[71063]:   <metadata>
Apr 11 17:03:31 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:31 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-1483979995</nova:name>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:30</nova:creationTime>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:31 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:31 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:31 user nova-compute[71063]:         <nova:port uuid="6b20a003-d501-4958-9c8c-567343698e97">
Apr 11 17:03:31 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 17:03:31 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:31 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:31 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:31 user nova-compute[71063]:   </metadata>
Apr 11 17:03:31 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:31 user nova-compute[71063]:     <system>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="serial">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="uuid">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:03:31 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:31 user nova-compute[71063]:     </system>
Apr 11 17:03:31 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:31 user nova-compute[71063]:   <os>
Apr 11 17:03:31 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:31 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:31 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:31 user nova-compute[71063]:   </os>
Apr 11 17:03:31 user nova-compute[71063]:   <features>
Apr 11 17:03:31 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:31 user nova-compute[71063]:     <apic/>
Apr 11 17:03:31 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:31 user nova-compute[71063]:   </features>
Apr 11 17:03:31 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:31 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:31 user nova-compute[71063]:   </clock>
Apr 11 17:03:31 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:31 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:31 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:31 user nova-compute[71063]:   </cpu>
Apr 11 17:03:31 user nova-compute[71063]:   <devices>
Apr 11 17:03:31 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:31 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:31 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk"/>
Apr 11 17:03:31 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:     </disk>
Apr 11 17:03:31 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:31 user nova-compute[71063]:       <mac address="fa:16:3e:6d:79:2f"/>
Apr 11 17:03:31 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:31 user nova-compute[71063]:       <target dev="tap6b20a003-d5"/>
Apr 11 17:03:31 user nova-compute[71063]:     </interface>
Apr 11 17:03:31 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:31 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log" append="off"/>
Apr 11 17:03:31 user nova-compute[71063]:     </serial>
Apr 11 17:03:31 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:31 user nova-compute[71063]:     <video>
Apr 11 17:03:31 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:31 user nova-compute[71063]:     </video>
Apr 11 17:03:31 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:31 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:31 user nova-compute[71063]:     </rng>
Apr 11 17:03:31 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:31 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:31 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:31 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:31 user nova-compute[71063]:   </devices>
Apr 11 17:03:31 user nova-compute[71063]: </domain>
Apr 11 17:03:31 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-1483979995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG os_vif [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4b45a7-1e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b4b45a7-1e, col_values=(('external_ids', {'iface-id': '8b4b45a7-1e14-4c93-a6a9-fe814512cef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9e:29', 'vm-uuid': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:31 user nova-compute[71063]: INFO os_vif [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b20a003-d5, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b20a003-d5, col_values=(('external_ids', {'iface-id': '6b20a003-d501-4958-9c8c-567343698e97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:79:2f', 'vm-uuid': '1fc7677c-cbd9-48e7-be62-2210074bc87a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:31 user nova-compute[71063]: INFO os_vif [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Took 22.06 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Instance spawned successfully.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Took 23.53 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7458541, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Started (Lifecycle Event)
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Took 18.69 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Took 22.05 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:6d:79:2f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Took 17.16 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:31 user nova-compute[71063]: INFO nova.compute.manager [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Took 23.34 seconds to build instance.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No VIF found with MAC fa:16:3e:42:9e:29, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.583s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.745952, 25935a69-292b-4d55-932c-f4893838998c => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Started (Lifecycle Event)
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:32 user nova-compute[71063]: WARNING nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state None.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:32 user nova-compute[71063]: WARNING nova.compute.manager [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state building and task_state spawning.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.491s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Took 23.20 seconds to build instance.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.340s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7460287, 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] VM Resumed (Lifecycle Event)
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7460902, 58e3bca8-f38a-45d1-98c2-06391f9f31fd => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] VM Resumed (Lifecycle Event)
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Took 25.58 seconds to build instance.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Took 18.80 seconds to build instance.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Took 20.39 seconds to build instance.
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.816s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.claims [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Claim successful on node user
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.944s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.558s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.7477326, 58e3bca8-f38a-45d1-98c2-06391f9f31fd => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] VM Started (Lifecycle Event)
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.749637, 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] VM Started (Lifecycle Event)
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Creating image(s)
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "038279a975daaeb597066b1fc1e83dedcc6e146f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "038279a975daaeb597066b1fc1e83dedcc6e146f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.9861715, 05988541-51cb-4e52-912e-ddf2b773db6b => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] VM Resumed (Lifecycle Event)
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232610.986462, 05988541-51cb-4e52-912e-ddf2b773db6b => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] VM Started (Lifecycle Event)
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.policy [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c4b1a17c7804cd4ba2ad825e0cc2dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7d76a8d4544e2b84d52eebb6d4b5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.part --force-share --output=json" returned: 0 in 0.195s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.virt.images [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] c6bd1738-b766-4c42-8e29-ec27c8534889 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.part /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.part /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.converted" returned: 0 in 0.450s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.630s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "038279a975daaeb597066b1fc1e83dedcc6e146f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.408s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:34 user nova-compute[71063]: WARNING nova.compute.manager [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state active and task_state None.
Apr 11 17:03:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json" returned: 0 in 0.262s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "038279a975daaeb597066b1fc1e83dedcc6e146f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "038279a975daaeb597066b1fc1e83dedcc6e146f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Creating image(s)
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "/opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "/opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "/opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json" returned: 0 in 0.315s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f,backing_fmt=raw /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f,backing_fmt=raw /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk 1073741824" returned: 0 in 0.069s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "038279a975daaeb597066b1fc1e83dedcc6e146f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.policy [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.243s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Successfully created port: c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/038279a975daaeb597066b1fc1e83dedcc6e146f --force-share --output=json" returned: 0 in 0.333s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.264s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk 1073741824" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Cannot resize image /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'migration_context' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Ensure instance console log exists: /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:35 user nova-compute[71063]: WARNING nova.compute.manager [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state building and task_state spawning.
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.354s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Cannot resize image /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'migration_context' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Ensure instance console log exists: /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.009s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:36 user nova-compute[71063]: WARNING nova.compute.manager [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state building and task_state spawning.
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Successfully updated port: c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquired lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updating instance_info_cache with network_info: [{"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Releasing lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Instance network_info: |[{"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Start _get_guest_xml network_info=[{"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:03:19Z,direct_url=<?>,disk_format='qcow2',id=c6bd1738-b766-4c42-8e29-ec27c8534889,min_disk=0,min_ram=0,name='',owner='175e4679507c49ea8e2b8618606735fe',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:03:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'image_id': 'c6bd1738-b766-4c42-8e29-ec27c8534889'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:38 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:38 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:03:19Z,direct_url=<?>,disk_format='qcow2',id=c6bd1738-b766-4c42-8e29-ec27c8534889,min_disk=0,min_ram=0,name='',owner='175e4679507c49ea8e2b8618606735fe',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:03:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-790493278',display_name='tempest-AttachSCSIVolumeTestJSON-server-790493278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-790493278',id=8,image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYkCAEQ+bl11uHPZVQKbgG6myknafTn09U4qfFdXo5BEH//wtE/q6s8OBga0Azbc9wMj6qkFejLKmdVWResnP4PMs0NtC25KI97YqzyPazY0r+rOz1TGx6RxCixovI8Ow==',key_name='tempest-keypair-208324507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c7d76a8d4544e2b84d52eebb6d4b5b1',ramdisk_id='',reservation_id='r-odsbdqxw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1826674867',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1826674867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c4b1a17c7804cd4ba2ad825e0cc2dd0',uuid=cdd4a3a0-35a6-4f62-abc1-6a806ab62783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converting VIF {"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'pci_devices' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:38 user nova-compute[71063]: WARNING nova.compute.manager [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state building and task_state spawning.
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-changed-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Refreshing instance network info cache due to event network-changed-c93de33f-8a35-40fb-bb48-f717e6fb90f6. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Acquiring lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Acquired lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Refreshing network info cache for port c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:38 user nova-compute[71063]:   <uuid>cdd4a3a0-35a6-4f62-abc1-6a806ab62783</uuid>
Apr 11 17:03:38 user nova-compute[71063]:   <name>instance-00000008</name>
Apr 11 17:03:38 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:38 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:38 user nova-compute[71063]:   <metadata>
Apr 11 17:03:38 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:38 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-790493278</nova:name>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:38</nova:creationTime>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:38 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:38 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:user uuid="1c4b1a17c7804cd4ba2ad825e0cc2dd0">tempest-AttachSCSIVolumeTestJSON-1826674867-project-member</nova:user>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:project uuid="7c7d76a8d4544e2b84d52eebb6d4b5b1">tempest-AttachSCSIVolumeTestJSON-1826674867</nova:project>
Apr 11 17:03:38 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:root type="image" uuid="c6bd1738-b766-4c42-8e29-ec27c8534889"/>
Apr 11 17:03:38 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:38 user nova-compute[71063]:         <nova:port uuid="c93de33f-8a35-40fb-bb48-f717e6fb90f6">
Apr 11 17:03:38 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 17:03:38 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:38 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:38 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:38 user nova-compute[71063]:   </metadata>
Apr 11 17:03:38 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:38 user nova-compute[71063]:     <system>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="serial">cdd4a3a0-35a6-4f62-abc1-6a806ab62783</entry>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="uuid">cdd4a3a0-35a6-4f62-abc1-6a806ab62783</entry>
Apr 11 17:03:38 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:38 user nova-compute[71063]:     </system>
Apr 11 17:03:38 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:38 user nova-compute[71063]:   <os>
Apr 11 17:03:38 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:38 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:38 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:38 user nova-compute[71063]:   </os>
Apr 11 17:03:38 user nova-compute[71063]:   <features>
Apr 11 17:03:38 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:38 user nova-compute[71063]:     <apic/>
Apr 11 17:03:38 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:38 user nova-compute[71063]:   </features>
Apr 11 17:03:38 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:38 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:38 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:38 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:38 user nova-compute[71063]:   </clock>
Apr 11 17:03:38 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:38 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:38 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:38 user nova-compute[71063]:   </cpu>
Apr 11 17:03:38 user nova-compute[71063]:   <devices>
Apr 11 17:03:38 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:38 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:38 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk"/>
Apr 11 17:03:38 user nova-compute[71063]:       <target dev="sda" bus="scsi"/>
Apr 11 17:03:38 user nova-compute[71063]:       <address type="drive" controller="0" unit="0"/>
Apr 11 17:03:38 user nova-compute[71063]:     </disk>
Apr 11 17:03:38 user nova-compute[71063]:     <disk type="file" device="cdrom">
Apr 11 17:03:38 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 17:03:38 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.config"/>
Apr 11 17:03:38 user nova-compute[71063]:       <target dev="sdb" bus="scsi"/>
Apr 11 17:03:38 user nova-compute[71063]:       <address type="drive" controller="0" unit="1"/>
Apr 11 17:03:38 user nova-compute[71063]:     </disk>
Apr 11 17:03:38 user nova-compute[71063]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 17:03:38 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:38 user nova-compute[71063]:       <mac address="fa:16:3e:b6:28:09"/>
Apr 11 17:03:38 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:38 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:38 user nova-compute[71063]:       <target dev="tapc93de33f-8a"/>
Apr 11 17:03:38 user nova-compute[71063]:     </interface>
Apr 11 17:03:38 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:38 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/console.log" append="off"/>
Apr 11 17:03:38 user nova-compute[71063]:     </serial>
Apr 11 17:03:38 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:38 user nova-compute[71063]:     <video>
Apr 11 17:03:38 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:38 user nova-compute[71063]:     </video>
Apr 11 17:03:38 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:38 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:38 user nova-compute[71063]:     </rng>
Apr 11 17:03:38 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:38 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:38 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:38 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:38 user nova-compute[71063]:   </devices>
Apr 11 17:03:38 user nova-compute[71063]: </domain>
Apr 11 17:03:38 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-790493278',display_name='tempest-AttachSCSIVolumeTestJSON-server-790493278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-790493278',id=8,image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYkCAEQ+bl11uHPZVQKbgG6myknafTn09U4qfFdXo5BEH//wtE/q6s8OBga0Azbc9wMj6qkFejLKmdVWResnP4PMs0NtC25KI97YqzyPazY0r+rOz1TGx6RxCixovI8Ow==',key_name='tempest-keypair-208324507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c7d76a8d4544e2b84d52eebb6d4b5b1',ramdisk_id='',reservation_id='r-odsbdqxw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1826674867',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1826674867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c4b1a17c7804cd4ba2ad825e0cc2dd0',uuid=cdd4a3a0-35a6-4f62-abc1-6a806ab62783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converting VIF {"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG os_vif [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93de33f-8a, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc93de33f-8a, col_values=(('external_ids', {'iface-id': 'c93de33f-8a35-40fb-bb48-f717e6fb90f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:28:09', 'vm-uuid': 'cdd4a3a0-35a6-4f62-abc1-6a806ab62783'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: INFO os_vif [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a')
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No BDM found with device name sda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No VIF found with MAC fa:16:3e:b6:28:09, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Using config drive
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Creating config drive at /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.config
Apr 11 17:03:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7u6yq79e {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updated VIF entry in instance network info cache for port c93de33f-8a35-40fb-bb48-f717e6fb90f6. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updating instance_info_cache with network_info: [{"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7u6yq79e" returned: 0 in 0.101s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Releasing lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232619.1132662, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Resumed (Lifecycle Event)
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance spawned successfully.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:39 user nova-compute[71063]: WARNING nova.compute.manager [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state building and task_state spawning.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232619.1197746, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Started (Lifecycle Event)
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance spawned successfully.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232619.1594296, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Resumed (Lifecycle Event)
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Took 27.33 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232619.1928952, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Started (Lifecycle Event)
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:39 user nova-compute[71063]: INFO nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Took 18.03 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:40 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:40 user nova-compute[71063]: INFO nova.compute.manager [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Took 28.49 seconds to build instance.
Apr 11 17:03:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.696s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:40 user nova-compute[71063]: INFO nova.compute.manager [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Took 19.13 seconds to build instance.
Apr 11 17:03:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Successfully created port: 68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.313s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] No waiting events found dispatching network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:41 user nova-compute[71063]: WARNING nova.compute.manager [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received unexpected event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance with vm_state building and task_state spawning.
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:41 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:03:41 user nova-compute[71063]: INFO nova.compute.claims [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Claim successful on node user
Apr 11 17:03:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.160s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:03:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:42 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:03:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.policy [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f20dcfb0f94c419b9111571e89bc3aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9791f1371ba74005a40cd51a63d63c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:03:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Creating image(s)
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "/opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "/opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "/opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] No waiting events found dispatching network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:43 user nova-compute[71063]: WARNING nova.compute.manager [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received unexpected event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance with vm_state building and task_state spawning.
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Successfully updated port: 68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.292s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquired lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-changed-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Refreshing instance network info cache due to event network-changed-68bea989-7c25-4d4d-aa6d-e4fe977ebb93. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Acquiring lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.330s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk 1073741824" returned: 0 in 0.125s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.459s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232624.267567, cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] VM Resumed (Lifecycle Event)
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Instance spawned successfully.
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Cannot resize image /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'migration_context' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Ensure instance console log exists: /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Took 11.57 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232624.269233, cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] VM Started (Lifecycle Event)
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:44 user nova-compute[71063]: INFO nova.compute.manager [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Took 15.89 seconds to build instance.
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Successfully created port: 3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating instance_info_cache with network_info: [{"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Releasing lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Instance network_info: |[{"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Acquired lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Refreshing network info cache for port 68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Start _get_guest_xml network_info=[{"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:45 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:45 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-758752172',display_name='tempest-VolumesAdminNegativeTest-server-758752172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-758752172',id=9,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXQASF5POVSKT+6Cb9neB2DzmtcARSnrw7alBnxX24AHH7TdoZurn7Zjp47ozOOPlermL7JqhMAZ5O9u9neGe4Or35NaG0Z9zNUT9CetsumcUKjlTrO2prLN5MOqot/oQ==',key_name='tempest-keypair-1343943661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-zp1i6060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d111d892e2944f279a36622978b2dd06',uuid=2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.objects.instance [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'pci_devices' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:45 user nova-compute[71063]:   <uuid>2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e</uuid>
Apr 11 17:03:45 user nova-compute[71063]:   <name>instance-00000009</name>
Apr 11 17:03:45 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:45 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:45 user nova-compute[71063]:   <metadata>
Apr 11 17:03:45 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:45 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:name>tempest-VolumesAdminNegativeTest-server-758752172</nova:name>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:45</nova:creationTime>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:45 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:45 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:user uuid="d111d892e2944f279a36622978b2dd06">tempest-VolumesAdminNegativeTest-1639987679-project-member</nova:user>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:project uuid="381738c7ad99437b875807c4252965bf">tempest-VolumesAdminNegativeTest-1639987679</nova:project>
Apr 11 17:03:45 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:45 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:45 user nova-compute[71063]:         <nova:port uuid="68bea989-7c25-4d4d-aa6d-e4fe977ebb93">
Apr 11 17:03:45 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:03:45 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:45 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:45 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:45 user nova-compute[71063]:   </metadata>
Apr 11 17:03:45 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:45 user nova-compute[71063]:     <system>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="serial">2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e</entry>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="uuid">2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e</entry>
Apr 11 17:03:45 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:45 user nova-compute[71063]:     </system>
Apr 11 17:03:45 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:45 user nova-compute[71063]:   <os>
Apr 11 17:03:45 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:45 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:45 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:45 user nova-compute[71063]:   </os>
Apr 11 17:03:45 user nova-compute[71063]:   <features>
Apr 11 17:03:45 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:45 user nova-compute[71063]:     <apic/>
Apr 11 17:03:45 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:45 user nova-compute[71063]:   </features>
Apr 11 17:03:45 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:45 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:45 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:45 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:45 user nova-compute[71063]:   </clock>
Apr 11 17:03:45 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:45 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:45 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:45 user nova-compute[71063]:   </cpu>
Apr 11 17:03:45 user nova-compute[71063]:   <devices>
Apr 11 17:03:45 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:45 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:45 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk"/>
Apr 11 17:03:45 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:45 user nova-compute[71063]:     </disk>
Apr 11 17:03:45 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:45 user nova-compute[71063]:       <mac address="fa:16:3e:70:3f:0d"/>
Apr 11 17:03:45 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:45 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:45 user nova-compute[71063]:       <target dev="tap68bea989-7c"/>
Apr 11 17:03:45 user nova-compute[71063]:     </interface>
Apr 11 17:03:45 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:45 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/console.log" append="off"/>
Apr 11 17:03:45 user nova-compute[71063]:     </serial>
Apr 11 17:03:45 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:45 user nova-compute[71063]:     <video>
Apr 11 17:03:45 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:45 user nova-compute[71063]:     </video>
Apr 11 17:03:45 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:45 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:45 user nova-compute[71063]:     </rng>
Apr 11 17:03:45 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:45 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:45 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:45 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:45 user nova-compute[71063]:   </devices>
Apr 11 17:03:45 user nova-compute[71063]: </domain>
Apr 11 17:03:45 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-758752172',display_name='tempest-VolumesAdminNegativeTest-server-758752172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-758752172',id=9,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXQASF5POVSKT+6Cb9neB2DzmtcARSnrw7alBnxX24AHH7TdoZurn7Zjp47ozOOPlermL7JqhMAZ5O9u9neGe4Or35NaG0Z9zNUT9CetsumcUKjlTrO2prLN5MOqot/oQ==',key_name='tempest-keypair-1343943661',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-zp1i6060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d111d892e2944f279a36622978b2dd06',uuid=2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG os_vif [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68bea989-7c, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68bea989-7c, col_values=(('external_ids', {'iface-id': '68bea989-7c25-4d4d-aa6d-e4fe977ebb93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:3f:0d', 'vm-uuid': '2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:45 user nova-compute[71063]: INFO os_vif [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c')
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No VIF found with MAC fa:16:3e:70:3f:0d, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Successfully updated port: 3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquired lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-changed-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Refreshing instance network info cache due to event network-changed-3bc601e8-552e-473e-abe3-24e32a78188f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Acquiring lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.network.neutron [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updated VIF entry in instance network info cache for port 68bea989-7c25-4d4d-aa6d-e4fe977ebb93. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:46 user nova-compute[71063]: DEBUG nova.network.neutron [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating instance_info_cache with network_info: [{"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Releasing lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updating instance_info_cache with network_info: [{"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Releasing lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Instance network_info: |[{"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Acquired lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.neutron [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Refreshing network info cache for port 3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Start _get_guest_xml network_info=[{"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:03:47 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:47 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1632556398',display_name='tempest-TestVolumeSwap-server-1632556398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1632556398',id=10,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwQqBR25F/d8+YQpxEvpMHcmc9ai8/bmMyB08gTAOS/9e0+ptL1kApIgEHLD2wpbxwJv/e1PvASxFkuguZZmHUsixgqr0BQkG9MSSBFMuViP9XL3XIwb0RQ4dQ2b71JAw==',key_name='tempest-keypair-527051490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9791f1371ba74005a40cd51a63d63c94',ramdisk_id='',reservation_id='r-cctxzye8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1972836137',owner_user_name='tempest-TestVolumeSwap-1972836137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20dcfb0f94c419b9111571e89bc3aa4',uuid=180c44cc-172d-4e8c-b4ec-6259e775c404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converting VIF {"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'pci_devices' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:03:47 user nova-compute[71063]:   <uuid>180c44cc-172d-4e8c-b4ec-6259e775c404</uuid>
Apr 11 17:03:47 user nova-compute[71063]:   <name>instance-0000000a</name>
Apr 11 17:03:47 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:03:47 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:03:47 user nova-compute[71063]:   <metadata>
Apr 11 17:03:47 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:03:47 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:name>tempest-TestVolumeSwap-server-1632556398</nova:name>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:03:47</nova:creationTime>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:03:47 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:03:47 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:owner>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:user uuid="f20dcfb0f94c419b9111571e89bc3aa4">tempest-TestVolumeSwap-1972836137-project-member</nova:user>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:project uuid="9791f1371ba74005a40cd51a63d63c94">tempest-TestVolumeSwap-1972836137</nova:project>
Apr 11 17:03:47 user nova-compute[71063]:       </nova:owner>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:03:47 user nova-compute[71063]:       <nova:ports>
Apr 11 17:03:47 user nova-compute[71063]:         <nova:port uuid="3bc601e8-552e-473e-abe3-24e32a78188f">
Apr 11 17:03:47 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:03:47 user nova-compute[71063]:         </nova:port>
Apr 11 17:03:47 user nova-compute[71063]:       </nova:ports>
Apr 11 17:03:47 user nova-compute[71063]:     </nova:instance>
Apr 11 17:03:47 user nova-compute[71063]:   </metadata>
Apr 11 17:03:47 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:03:47 user nova-compute[71063]:     <system>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="serial">180c44cc-172d-4e8c-b4ec-6259e775c404</entry>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="uuid">180c44cc-172d-4e8c-b4ec-6259e775c404</entry>
Apr 11 17:03:47 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:03:47 user nova-compute[71063]:     </system>
Apr 11 17:03:47 user nova-compute[71063]:   </sysinfo>
Apr 11 17:03:47 user nova-compute[71063]:   <os>
Apr 11 17:03:47 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:03:47 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:03:47 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:03:47 user nova-compute[71063]:   </os>
Apr 11 17:03:47 user nova-compute[71063]:   <features>
Apr 11 17:03:47 user nova-compute[71063]:     <acpi/>
Apr 11 17:03:47 user nova-compute[71063]:     <apic/>
Apr 11 17:03:47 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:03:47 user nova-compute[71063]:   </features>
Apr 11 17:03:47 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:03:47 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:03:47 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:03:47 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:03:47 user nova-compute[71063]:   </clock>
Apr 11 17:03:47 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:03:47 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:03:47 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:03:47 user nova-compute[71063]:   </cpu>
Apr 11 17:03:47 user nova-compute[71063]:   <devices>
Apr 11 17:03:47 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:03:47 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:03:47 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk"/>
Apr 11 17:03:47 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:03:47 user nova-compute[71063]:     </disk>
Apr 11 17:03:47 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:03:47 user nova-compute[71063]:       <mac address="fa:16:3e:90:90:b4"/>
Apr 11 17:03:47 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:47 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:03:47 user nova-compute[71063]:       <target dev="tap3bc601e8-55"/>
Apr 11 17:03:47 user nova-compute[71063]:     </interface>
Apr 11 17:03:47 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:03:47 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/console.log" append="off"/>
Apr 11 17:03:47 user nova-compute[71063]:     </serial>
Apr 11 17:03:47 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:03:47 user nova-compute[71063]:     <video>
Apr 11 17:03:47 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:03:47 user nova-compute[71063]:     </video>
Apr 11 17:03:47 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:03:47 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:03:47 user nova-compute[71063]:     </rng>
Apr 11 17:03:47 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:03:47 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:03:47 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:03:47 user nova-compute[71063]:     </memballoon>
Apr 11 17:03:47 user nova-compute[71063]:   </devices>
Apr 11 17:03:47 user nova-compute[71063]: </domain>
Apr 11 17:03:47 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1632556398',display_name='tempest-TestVolumeSwap-server-1632556398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1632556398',id=10,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwQqBR25F/d8+YQpxEvpMHcmc9ai8/bmMyB08gTAOS/9e0+ptL1kApIgEHLD2wpbxwJv/e1PvASxFkuguZZmHUsixgqr0BQkG9MSSBFMuViP9XL3XIwb0RQ4dQ2b71JAw==',key_name='tempest-keypair-527051490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9791f1371ba74005a40cd51a63d63c94',ramdisk_id='',reservation_id='r-cctxzye8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1972836137',owner_user_name='tempest-TestVolumeSwap-1972836137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20dcfb0f94c419b9111571e89bc3aa4',uuid=180c44cc-172d-4e8c-b4ec-6259e775c404,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converting VIF {"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG os_vif [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bc601e8-55, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3bc601e8-55, col_values=(('external_ids', {'iface-id': '3bc601e8-552e-473e-abe3-24e32a78188f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:90:b4', 'vm-uuid': '180c44cc-172d-4e8c-b4ec-6259e775c404'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:47 user nova-compute[71063]: INFO os_vif [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55')
Apr 11 17:03:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] No VIF found with MAC fa:16:3e:90:90:b4, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] No waiting events found dispatching network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:48 user nova-compute[71063]: WARNING nova.compute.manager [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received unexpected event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance with vm_state building and task_state spawning.
Apr 11 17:03:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updated VIF entry in instance network info cache for port 3bc601e8-552e-473e-abe3-24e32a78188f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updating instance_info_cache with network_info: [{"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Releasing lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] No waiting events found dispatching network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:50 user nova-compute[71063]: WARNING nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received unexpected event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance with vm_state building and task_state spawning.
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] No waiting events found dispatching network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:50 user nova-compute[71063]: WARNING nova.compute.manager [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received unexpected event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f for instance with vm_state building and task_state spawning.
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232630.717794, 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:50 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] VM Resumed (Lifecycle Event)
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:50 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Instance spawned successfully.
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:50 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232630.7216344, 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:50 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] VM Started (Lifecycle Event)
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:50 user nova-compute[71063]: INFO nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Took 16.02 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Took 18.51 seconds to build instance.
Apr 11 17:03:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.158s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] No waiting events found dispatching network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:03:52 user nova-compute[71063]: WARNING nova.compute.manager [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received unexpected event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f for instance with vm_state building and task_state spawning.
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232632.7416549, 180c44cc-172d-4e8c-b4ec-6259e775c404 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] VM Resumed (Lifecycle Event)
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Instance spawned successfully.
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232632.7432783, 180c44cc-172d-4e8c-b4ec-6259e775c404 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] VM Started (Lifecycle Event)
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:03:52 user nova-compute[71063]: INFO nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Took 9.63 seconds to spawn the instance on the hypervisor.
Apr 11 17:03:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:03:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:53 user nova-compute[71063]: INFO nova.compute.manager [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Took 11.49 seconds to build instance.
Apr 11 17:03:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.899s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:03:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:03:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:03:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:03:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:03 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:03 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7404MB free_disk=26.72138214111328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:04:03 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:04:04 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:04:04 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:04:04 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:04:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.907s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:10 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:04:10 user nova-compute[71063]: INFO nova.compute.claims [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Claim successful on node user
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.011s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:04:11 user nova-compute[71063]: INFO nova.compute.claims [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Claim successful on node user
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:04:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.policy [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:04:11 user nova-compute[71063]: INFO nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Booting with volume d307a14d-98e3-406f-baef-24e6a61dc887 at /dev/vda
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:11 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxy2tw6l3/privsep.sock']
Apr 11 17:04:11 user sudo[81524]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxy2tw6l3/privsep.sock
Apr 11 17:04:11 user sudo[81524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 17:04:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:04:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:04:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:04:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:04:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:04:12 user nova-compute[71063]: INFO nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Booting with volume ef3cc231-2504-4ee1-a0e8-daabd3795b23 at /dev/vda
Apr 11 17:04:12 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:12 user nova-compute[71063]: DEBUG nova.policy [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:04:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully created port: 7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully created port: dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully created port: c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:13 user sudo[81524]: pam_unix(sudo:session): session closed for user root
Apr 11 17:04:13 user nova-compute[71063]: INFO oslo.privsep.daemon [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Spawned new privsep daemon via rootwrap
Apr 11 17:04:13 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 17:04:13 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 17:04:13 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 17:04:13 user nova-compute[71063]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81529
Apr 11 17:04:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1225170c-1712-4e12-87f9-b262c404c709]: (2,) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:13 user nova-compute[71063]: WARNING oslo_privsep.priv_context [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] privsep daemon already running
Apr 11 17:04:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully created port: 84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully created port: 8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c91e50-f207-4d7f-ae6b-6c2886158f5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: WARNING os_brick.initiator.connectors.nvmeof [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc248ca2-717e-4277-9503-1fdef579a360]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c87ac51-d984-4a9b-8be4-33a21ec7a20f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792918a-134d-4dfb-a292-fa72ccdbaed1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a57c95-32bf-476f-ad52-ff76520592ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f578dc0-4d98-4bf8-a45d-94b3bc35f000]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731050d-2313-489f-8349-e4f933166ced]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c9baeb-7c46-4c85-ab52-ef06e4df85d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:14 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8899e183-b69a-4f28-aa9e-9b7cb5f5116d]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:14 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf2e0f-6514-47e8-b927-18e1e59c2527]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== get_connector_properties: return (2360ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating existing volume attachment record: 56fa3934-51e1-4b23-845b-38b102ce1626 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== get_connector_properties: return (2035ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating existing volume attachment record: 12bea081-fd6d-4400-9850-29c1f490dec6 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:04:14 user nova-compute[71063]: INFO nova.compute.claims [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Claim successful on node user
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully created port: 39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully created port: 99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:04:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:04:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.policy [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:04:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Creating image(s)
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "/opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "/opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "/opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully created port: 50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully created port: 51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk 1073741824" returned: 0 in 0.047s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Cannot resize image /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'migration_context' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Ensure instance console log exists: /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully created port: 9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: 7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-7320c7cb-cd67-4b96-bcd0-865515f9b472. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Successfully created port: dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Successfully updated port: dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquired lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing instance network info cache due to event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Acquiring lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating instance_info_cache with network_info: [{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Releasing lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Instance network_info: |[{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Acquired lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Start _get_guest_xml network_info=[{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:04:17 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:17 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2117639307',display_name='tempest-TestStampPattern-server-2117639307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2117639307',id=13,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-uixjcn3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:15Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=9339e177-6264-4942-9dd1-372681209790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'pci_devices' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:04:17 user nova-compute[71063]:   <uuid>9339e177-6264-4942-9dd1-372681209790</uuid>
Apr 11 17:04:17 user nova-compute[71063]:   <name>instance-0000000d</name>
Apr 11 17:04:17 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:04:17 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:04:17 user nova-compute[71063]:   <metadata>
Apr 11 17:04:17 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:04:17 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:name>tempest-TestStampPattern-server-2117639307</nova:name>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:04:17</nova:creationTime>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:04:17 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:04:17 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:owner>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:user uuid="1f7d3b94cc6b4a7d95489d7d4cf6e297">tempest-TestStampPattern-1846780226-project-member</nova:user>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:project uuid="ec4085a617084465ae810ff06498f992">tempest-TestStampPattern-1846780226</nova:project>
Apr 11 17:04:17 user nova-compute[71063]:       </nova:owner>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:04:17 user nova-compute[71063]:       <nova:ports>
Apr 11 17:04:17 user nova-compute[71063]:         <nova:port uuid="dbe2ecc7-b16b-4a77-8bf7-650a08d999ce">
Apr 11 17:04:17 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 17:04:17 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:17 user nova-compute[71063]:       </nova:ports>
Apr 11 17:04:17 user nova-compute[71063]:     </nova:instance>
Apr 11 17:04:17 user nova-compute[71063]:   </metadata>
Apr 11 17:04:17 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:04:17 user nova-compute[71063]:     <system>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="serial">9339e177-6264-4942-9dd1-372681209790</entry>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="uuid">9339e177-6264-4942-9dd1-372681209790</entry>
Apr 11 17:04:17 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:04:17 user nova-compute[71063]:     </system>
Apr 11 17:04:17 user nova-compute[71063]:   </sysinfo>
Apr 11 17:04:17 user nova-compute[71063]:   <os>
Apr 11 17:04:17 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:04:17 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:04:17 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:04:17 user nova-compute[71063]:   </os>
Apr 11 17:04:17 user nova-compute[71063]:   <features>
Apr 11 17:04:17 user nova-compute[71063]:     <acpi/>
Apr 11 17:04:17 user nova-compute[71063]:     <apic/>
Apr 11 17:04:17 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:04:17 user nova-compute[71063]:   </features>
Apr 11 17:04:17 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:04:17 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:04:17 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:04:17 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:04:17 user nova-compute[71063]:   </clock>
Apr 11 17:04:17 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:04:17 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:04:17 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:04:17 user nova-compute[71063]:   </cpu>
Apr 11 17:04:17 user nova-compute[71063]:   <devices>
Apr 11 17:04:17 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:04:17 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:04:17 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk"/>
Apr 11 17:04:17 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:04:17 user nova-compute[71063]:     </disk>
Apr 11 17:04:17 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:17 user nova-compute[71063]:       <mac address="fa:16:3e:b3:d9:49"/>
Apr 11 17:04:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:17 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:17 user nova-compute[71063]:       <target dev="tapdbe2ecc7-b1"/>
Apr 11 17:04:17 user nova-compute[71063]:     </interface>
Apr 11 17:04:17 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:04:17 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/console.log" append="off"/>
Apr 11 17:04:17 user nova-compute[71063]:     </serial>
Apr 11 17:04:17 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:04:17 user nova-compute[71063]:     <video>
Apr 11 17:04:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:17 user nova-compute[71063]:     </video>
Apr 11 17:04:17 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:04:17 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:04:17 user nova-compute[71063]:     </rng>
Apr 11 17:04:17 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:04:17 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:04:17 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:04:17 user nova-compute[71063]:     </memballoon>
Apr 11 17:04:17 user nova-compute[71063]:   </devices>
Apr 11 17:04:17 user nova-compute[71063]: </domain>
Apr 11 17:04:17 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2117639307',display_name='tempest-TestStampPattern-server-2117639307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2117639307',id=13,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-uixjcn3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:15Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=9339e177-6264-4942-9dd1-372681209790,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG os_vif [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbe2ecc7-b1, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbe2ecc7-b1, col_values=(('external_ids', {'iface-id': 'dbe2ecc7-b16b-4a77-8bf7-650a08d999ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d9:49', 'vm-uuid': '9339e177-6264-4942-9dd1-372681209790'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:17 user nova-compute[71063]: INFO os_vif [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1')
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No VIF found with MAC fa:16:3e:b3:d9:49, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-dfdf099d-908f-40d1-937c-cfa70a5b38b5. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: 818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updated VIF entry in instance network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating instance_info_cache with network_info: [{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Releasing lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-a4c6824f-e5f7-4f25-81eb-5cc534c99636. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-818fbdc6-1f85-4f25-a9a8-99aec719102e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: INFO nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Booting with volume a309ad9f-380c-4dda-83e1-7f5f0acf75b3 at /dev/vdb
Apr 11 17:04:19 user nova-compute[71063]: INFO nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Booting with volume a7454087-e7d4-4c56-a159-187cdd2dc184 at /dev/vdb
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Acquiring lock "9339e177-6264-4942-9dd1-372681209790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] No waiting events found dispatching network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:19 user nova-compute[71063]: WARNING nova.compute.manager [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received unexpected event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance with vm_state building and task_state spawning.
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd0ff80-66fd-4b6a-98b0-40deaec8dc25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[84653e3e-4843-4d1e-a133-4bfe6dca2a75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a1e8c-f5e9-4a3e-a1a6-1c50b2080f2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a658ba-7170-441e-8c71-b23261d166aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d87a23c-fc48-4cd8-b817-01c997d93d09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9bec6d-e80f-4917-b4cf-cf4fed609d68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8499ca07-7067-43b5-b1be-a3c91e7d91b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2425f84c-f511-452e-86fc-e9e73cf05162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:19 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ee178-7790-4adf-9527-0678693e79b6]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating existing volume attachment record: c9e3d490-7c99-4c05-b333-4badd46906fd {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:19 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f599099-e085-4210-b9da-422c3c514e76]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== get_connector_properties: return (243ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating existing volume attachment record: 51ac19d7-7538-480a-abf3-a692914b2fce {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: 8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-f73daf99-e281-41dc-87d9-f257045a8146. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: 0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-c6dc07d2-c1e5-44f7-8683-0162519e8613. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: 99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-8a27e645-0909-4786-a624-5d12630f2e1b. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: 84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Successfully updated port: 51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Acquiring lock "9339e177-6264-4942-9dd1-372681209790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] No waiting events found dispatching network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:21 user nova-compute[71063]: WARNING nova.compute.manager [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received unexpected event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance with vm_state building and task_state spawning.
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232661.604457, 9339e177-6264-4942-9dd1-372681209790 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] VM Resumed (Lifecycle Event)
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9339e177-6264-4942-9dd1-372681209790] Instance spawned successfully.
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232661.604837, 9339e177-6264-4942-9dd1-372681209790 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] VM Started (Lifecycle Event)
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Took 6.56 seconds to spawn the instance on the hypervisor.
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-0affebd5-561c-497c-9491-338dce8905e9. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port 0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:21 user nova-compute[71063]: INFO nova.compute.manager [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Took 7.62 seconds to build instance.
Apr 11 17:04:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.814s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: 39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-84d3c99c-9ae0-4d15-8338-ece1d9a04125. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port 84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-99ac8a24-e783-4834-a419-d58b3e288aa4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: 50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-50c39df9-0b72-4b14-96ca-356d0dc32f1c. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port 50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Successfully updated port: 9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-39c10a5f-6007-4268-a337-da0f1c17c553. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:24 user nova-compute[71063]: INFO nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Booting with volume 498b42b1-60cf-4372-a5cf-6cdea4caded0 at /dev/vdc
Apr 11 17:04:24 user nova-compute[71063]: INFO nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Booting with volume b187ea12-9922-4398-a612-60259900feee at /dev/vdc
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e28425c-b117-4487-8b7d-3c1b326b9255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a658b8-0187-42bb-9375-cf85e6cae94f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c83811-bf93-4a31-ae12-ee0984742b1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9614165-38ee-4fb2-b730-ae7d7de67c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c5628f-6873-455c-92ea-380f2882af5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af2726c-e97f-46cd-b6a0-e396ce1a0371]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance network_info: |[{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:24 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e253d3b4-7f15-4bc1-ae24-635b6451067d]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8bc90-b35e-47a4-b2f5-52d4f91de7bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating existing volume attachment record: 3aa518a5-ce08-40db-b58f-44cc2447bdcc {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70037f7-1e4a-455c-8349-2e6d5dbba8ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:04:24 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:04:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4a331-efc0-455e-a3ad-9c6b3e4148ae]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:24 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating existing volume attachment record: 905db5f9-0989-44f3-ae5d-7054b556d86e {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updated VIF entry in instance network info cache for port 99ac8a24-e783-4834-a419-d58b3e288aa4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-51a3c765-0fbe-472f-bf1d-a49f663bdeea. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:04:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updated VIF entry in instance network info cache for port 51a3c765-0fbe-472f-bf1d-a49f663bdeea. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance network_info: |[{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port 39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updated VIF entry in instance network info cache for port 39c10a5f-6007-4268-a337-da0f1c17c553. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port 9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updated VIF entry in instance network info cache for port 9d81600b-d6e0-4715-9c00-f24f7a2d8fcb. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:04:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:04:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Creating image(s)
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Ensure instance console log exists: /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Start _get_guest_xml network_info=[{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '56fa3934-51e1-4b23-845b-38b102ce1626', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDawqmRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b822b32-bf4e-43e4-9024-32318a7db4ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'd307a14d-98e3-406f-baef-24e6a61dc887', 'serial': 'd307a14d-98e3-406f-baef-24e6a61dc887'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'c9e3d490-7c99-4c05-b333-4badd46906fd', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIkXgCql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b822b32-bf4e-43e4-9024-32318a7db4ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 'serial': 'a309ad9f-380c-4dda-83e1-7f5f0acf75b3'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '3aa518a5-ce08-40db-b58f-44cc2447bdcc', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fklIOKSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b822b32-bf4e-43e4-9024-32318a7db4ee', 'attached_at': '', 'detached_at': '', 'volume_id': '498b42b1-60cf-4372-a5cf-6cdea4caded0', 'serial': '498b42b1-60cf-4372-a5cf-6cdea4caded0'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connector [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Factory for ISCSI on None {{(pid=71063) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDawqmRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:29 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa0669-c8f2-4a03-b649-a394cffd23b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:29 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a727b-365b-4d2e-8e0a-5d2a15558ace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887] added
Apr 11 17:04:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0be86bd-2825-4c67-bbc1-4b4fa799428a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:04:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Creating image(s)
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Start _get_guest_xml network_info=[{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '12bea081-fd6d-4400-9850-29c1f490dec6', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXGrkOcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef3cc231-2504-4ee1-a0e8-daabd3795b23', 'serial': 'ef3cc231-2504-4ee1-a0e8-daabd3795b23'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '51ac19d7-7538-480a-abf3-a692914b2fce', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKcvVxyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7454087-e7d4-4c56-a159-187cdd2dc184', 'serial': 'a7454087-e7d4-4c56-a159-187cdd2dc184'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '905db5f9-0989-44f3-ae5d-7054b556d86e', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvzhAsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b187ea12-9922-4398-a612-60259900feee', 'serial': 'b187ea12-9922-4398-a612-60259900feee'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3759e-1eab-46e9-a198-831fa6398bfa]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDawqmRJ {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXGrkOcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDawqmRJ" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898ced0-b5dc-4e37-b6b7-3ba36d8a815c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MDawqmRJ'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbcdcd8-31e9-4893-963a-ae6f3c142c05]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabdbdb0-53a6-4ccd-bdcd-95ce07446892]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:04:29 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:04:29 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:04:29 user nova-compute[71063]: 
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf20648-06d6-4bf3-993c-2860dfabe9c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260]
Apr 11 17:04:29 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f574f7-be51-4453-a424-db7eb9a77ccb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bf3028-bbd9-463e-921d-e86df2d6bbf9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45c10fa-de34-4193-8f49-0785f2c2f522]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDawqmRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23633393861383166', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633393861383166', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.180s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:30 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdee9ca-b62a-4cde-83dd-36b52ab0f58c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:30 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIkXgCql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a436e9b5-5d2b-4624-b47b-39424d4ac107]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23] added
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b592d22-7a8d-49f7-8eac-74fab7ae59dd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a85853-6163-4674-8207-178316d2fd4b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXGrkOcP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXGrkOcP" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f174adaf-4e9f-4402-a738-785390e3838f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXGrkOcP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f4535-6c7b-4cc2-91fe-a1b58842ba1c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[33382889-d091-4b75-8156-e651ccc202ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef7a7f-fe2c-4e7f-a733-ca82af17b10c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260]
Apr 11 17:04:30 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff666a-acd1-460d-8f69-0af59e73ae22]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f92e2b-c2d5-4f34-9f38-4a4fcec7fe92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e566b-d3fa-4378-a37c-6c8879af225d]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXGrkOcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== connect_volume: return (2527ms) {'type': 'block', 'scsi_wwn': '26166336364623866', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166336364623866', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.322s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:31 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:31 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bf9319-e2d7-4870-b7bf-b8b3f3581a17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:31 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKcvVxyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:31 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3738de5-c451-406b-841e-3e1e2928a19d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3] added
Apr 11 17:04:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d586557-f9bb-48c8-ab4a-e5cf1a4ec123]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e62f5-296f-4322-96d3-53adec31f641]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIkXgCql {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIkXgCql" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2353e-581b-4fce-8afc-beda0ecbc4a6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIkXgCql'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb9111-985c-472c-b237-c1bc7f57596f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f8f0b-c0ab-4c82-ba72-d3b86a40a467]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dde835-d65e-4992-84bb-7f803b9a35cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260]
Apr 11 17:04:32 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae8e6b-a051-459e-991e-5c2cbc37a030]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af51b0-381e-4426-bc85-18eba50bc449]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e086af0d-98ed-4a03-b6a0-6fc40681b37b]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIkXgCql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== connect_volume: return (2630ms) {'type': 'block', 'scsi_wwn': '23464356337626338', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464356337626338', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.280s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:33 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:33 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fklIOKSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:33 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ef80bb-b6bf-4c8c-b1c7-2f96c8a62285]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:33 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bed12b-b201-447f-b0f0-123cdc15f418]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184] added
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4950b46-207d-4e2f-ab78-1278625e4c04]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843a5af-cc74-4abc-8c4f-1d4df3d8b23f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKcvVxyu {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKcvVxyu" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[741aaa7b-d4c7-4bf1-95af-d9b1735ba901]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKcvVxyu'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027e701-5cca-4ef2-97bc-54c3b78bbba7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba021327-512f-452c-a3e8-747ab6e189e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9553c390-7a97-4284-8f93-a20fe95c634d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260]
Apr 11 17:04:33 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb011a-4ca1-4d5e-8678-ab65682915ff]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287098b-92be-4a2c-835d-411994cea0bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f978520-91ad-4f39-86bc-ee8a7b85659b]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKcvVxyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== connect_volume: return (2585ms) {'type': 'block', 'scsi_wwn': '26338653930653164', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338653930653164', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.282s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:34 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd129e74-f74e-42c4-b246-5b5e4a7c3658]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:34 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvzhAsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:04:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daeb724-7b6c-456d-b40b-635a9c80d6ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0] added
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ecd6ae-dd90-4825-adb5-ee6763b9fd07]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5bde5-66a7-429f-b091-7309abb99133]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fklIOKSy {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fklIOKSy" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59212a-02ec-4e56-a35f-d351f9d7af5f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fklIOKSy'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e9ee75-a373-4bdd-acaa-21507d663f4c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec9a427-5c73-456b-82c7-e1d6bc126aeb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0b91d9-e1ec-4cd0-8dcf-6edebc486be1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260]
Apr 11 17:04:34 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0ca314-a8e8-4be0-a435-7db2c1f2b9e1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a361897-8b5b-4aa0-bc9b-8897d3111ce3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[27addb08-d5e1-4ea1-8b13-7ab645e08fc5]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fklIOKSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== connect_volume: return (2581ms) {'type': 'block', 'scsi_wwn': '23337333463623139', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337333463623139', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.275s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:35 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:04:35 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b822b32-bf4e-43e4-9024-32318a7db4ee {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab8a3a0-3250-4c18-aa3b-fc35862413d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:04:35 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:04:35 user nova-compute[71063]:   <uuid>4b822b32-bf4e-43e4-9024-32318a7db4ee</uuid>
Apr 11 17:04:35 user nova-compute[71063]:   <name>instance-0000000b</name>
Apr 11 17:04:35 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:04:35 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:04:35 user nova-compute[71063]:   <metadata>
Apr 11 17:04:35 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:04:35 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:name>tempest-device-tagging-server-457045036</nova:name>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:04:29</nova:creationTime>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:04:35 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:04:35 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:owner>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:user uuid="9fda97057cf6440f8a117c8a01cde53a">tempest-TaggedBootDevicesTest-762093980-project-member</nova:user>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:project uuid="d5ab1632b5534eb9b5096d25137bd538">tempest-TaggedBootDevicesTest-762093980</nova:project>
Apr 11 17:04:35 user nova-compute[71063]:       </nova:owner>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:04:35 user nova-compute[71063]:       <nova:ports>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="7320c7cb-cd67-4b96-bcd0-865515f9b472">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="a4c6824f-e5f7-4f25-81eb-5cc534c99636">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="818fbdc6-1f85-4f25-a9a8-99aec719102e">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.113" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="c6dc07d2-c1e5-44f7-8683-0162519e8613">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="8a27e645-0909-4786-a624-5d12630f2e1b">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.8" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="99ac8a24-e783-4834-a419-d58b3e288aa4">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:         <nova:port uuid="51a3c765-0fbe-472f-bf1d-a49f663bdeea">
Apr 11 17:04:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 17:04:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:35 user nova-compute[71063]:       </nova:ports>
Apr 11 17:04:35 user nova-compute[71063]:     </nova:instance>
Apr 11 17:04:35 user nova-compute[71063]:   </metadata>
Apr 11 17:04:35 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:04:35 user nova-compute[71063]:     <system>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="serial">4b822b32-bf4e-43e4-9024-32318a7db4ee</entry>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="uuid">4b822b32-bf4e-43e4-9024-32318a7db4ee</entry>
Apr 11 17:04:35 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:04:35 user nova-compute[71063]:     </system>
Apr 11 17:04:35 user nova-compute[71063]:   </sysinfo>
Apr 11 17:04:35 user nova-compute[71063]:   <os>
Apr 11 17:04:35 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:04:35 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:04:35 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:04:35 user nova-compute[71063]:   </os>
Apr 11 17:04:35 user nova-compute[71063]:   <features>
Apr 11 17:04:35 user nova-compute[71063]:     <acpi/>
Apr 11 17:04:35 user nova-compute[71063]:     <apic/>
Apr 11 17:04:35 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:04:35 user nova-compute[71063]:   </features>
Apr 11 17:04:35 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:04:35 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:04:35 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:04:35 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:04:35 user nova-compute[71063]:   </clock>
Apr 11 17:04:35 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:04:35 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:04:35 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:04:35 user nova-compute[71063]:   </cpu>
Apr 11 17:04:35 user nova-compute[71063]:   <devices>
Apr 11 17:04:35 user nova-compute[71063]:     <disk type="file" device="cdrom">
Apr 11 17:04:35 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 17:04:35 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/disk.config"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="hda" bus="ide"/>
Apr 11 17:04:35 user nova-compute[71063]:     </disk>
Apr 11 17:04:35 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:35 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:35 user nova-compute[71063]:       <source dev="/dev/sdb"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <serial>d307a14d-98e3-406f-baef-24e6a61dc887</serial>
Apr 11 17:04:35 user nova-compute[71063]:     </disk>
Apr 11 17:04:35 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:35 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:35 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <serial>a309ad9f-380c-4dda-83e1-7f5f0acf75b3</serial>
Apr 11 17:04:35 user nova-compute[71063]:     </disk>
Apr 11 17:04:35 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:35 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:35 user nova-compute[71063]:       <source dev="/dev/sdf"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="vdc" bus="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <serial>498b42b1-60cf-4372-a5cf-6cdea4caded0</serial>
Apr 11 17:04:35 user nova-compute[71063]:     </disk>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:30:db:d9"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tap7320c7cb-cd"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:8c:4c:a5"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tapa4c6824f-e5"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:33:c9:3e"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tap818fbdc6-1f"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:e5:5c:3c"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tapc6dc07d2-c1"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:e2:c7:0a"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tap8a27e645-09"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:2e:28:a0"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tap99ac8a24-e7"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:35 user nova-compute[71063]:       <mac address="fa:16:3e:ac:6c:b0"/>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:35 user nova-compute[71063]:       <target dev="tap51a3c765-0f"/>
Apr 11 17:04:35 user nova-compute[71063]:     </interface>
Apr 11 17:04:35 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:04:35 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/console.log" append="off"/>
Apr 11 17:04:35 user nova-compute[71063]:     </serial>
Apr 11 17:04:35 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:04:35 user nova-compute[71063]:     <video>
Apr 11 17:04:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:35 user nova-compute[71063]:     </video>
Apr 11 17:04:35 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:04:35 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:04:35 user nova-compute[71063]:     </rng>
Apr 11 17:04:35 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:04:35 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:04:35 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:04:35 user nova-compute[71063]:     </memballoon>
Apr 11 17:04:35 user nova-compute[71063]:   </devices>
Apr 11 17:04:35 user nova-compute[71063]: </domain>
Apr 11 17:04:35 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7320c7cb-cd, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7320c7cb-cd, col_values=(('external_ids', {'iface-id': '7320c7cb-cd67-4b96-bcd0-865515f9b472', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:db:d9', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea5f13c-8830-472e-92e4-b18c21d809cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee] added
Apr 11 17:04:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd')
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4c6824f-e5, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4c6824f-e5, col_values=(('external_ids', {'iface-id': 'a4c6824f-e5f7-4f25-81eb-5cc534c99636', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:4c:a5', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcbcdf7-8d6b-438d-844f-9984dabdc359]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5')
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a9cdae-08ed-42f3-9706-0da1848cb328]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvzhAsx {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap818fbdc6-1f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap818fbdc6-1f, col_values=(('external_ids', {'iface-id': '818fbdc6-1f85-4f25-a9a8-99aec719102e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c9:3e', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UtvzhAsx" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b6bbf-f1c4-4038-8c56-2ca05e3f6bf2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UtvzhAsx'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f')
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6dc07d2-c1, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6dc07d2-c1, col_values=(('external_ids', {'iface-id': 'c6dc07d2-c1e5-44f7-8683-0162519e8613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:5c:3c', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942aeb4-6670-4990-9486-1e1e3e3c8f15]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca9dcd-f1a1-474a-ac8e-1e32ea9d12b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1')
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a27e645-09, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a27e645-09, col_values=(('external_ids', {'iface-id': '8a27e645-0909-4786-a624-5d12630f2e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c7:0a', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09')
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99ac8a24-e7, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99ac8a24-e7, col_values=(('external_ids', {'iface-id': '99ac8a24-e783-4834-a419-d58b3e288aa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:28:a0', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6bbf91-d72e-425e-b48d-5c382c3778f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260]
Apr 11 17:04:36 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260] successful.
Apr 11 17:04:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef1fe6f-a6a4-4076-a1d2-aba65f83e8da]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fefa24-a968-4865-b292-eb4999921993]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:04:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:04:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:04:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7')
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51a3c765-0f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51a3c765-0f, col_values=(('external_ids', {'iface-id': '51a3c765-0fbe-472f-bf1d-a49f663bdeea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:6c:b0', 'vm-uuid': '4b822b32-bf4e-43e4-9024-32318a7db4ee'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1cbfc4-6309-4536-bbf4-aa0236b13f95]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvzhAsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:36 user nova-compute[71063]: INFO os_vif [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f')
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] No BDM found with device name hda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] No VIF found with MAC fa:16:3e:30:db:d9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] No VIF found with MAC fa:16:3e:e2:c7:0a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:04:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Using config drive
Apr 11 17:04:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Creating config drive at /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/disk.config
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprpe7wt1g {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprpe7wt1g" returned: 0 in 0.054s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== connect_volume: return (2647ms) {'type': 'block', 'scsi_wwn': '26235333536633064', 'path': '/dev/sdg'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235333536633064', 'path': '/dev/sdg'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:04:37 user nova-compute[71063]:   <uuid>fc8f8805-6d61-45a5-b56f-d2c0b107e9c1</uuid>
Apr 11 17:04:37 user nova-compute[71063]:   <name>instance-0000000c</name>
Apr 11 17:04:37 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:04:37 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:04:37 user nova-compute[71063]:   <metadata>
Apr 11 17:04:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:04:37 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:name>tempest-device-tagging-server-956152073</nova:name>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:04:29</nova:creationTime>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:04:37 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:04:37 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:owner>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:user uuid="b2f35f746a2c41828b209a93f555993c">tempest-TaggedBootDevicesTest_v242-1893104567-project-member</nova:user>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:project uuid="6c144e1059e44b55bb7aa451b9547a75">tempest-TaggedBootDevicesTest_v242-1893104567</nova:project>
Apr 11 17:04:37 user nova-compute[71063]:       </nova:owner>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:04:37 user nova-compute[71063]:       <nova:ports>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="dfdf099d-908f-40d1-937c-cfa70a5b38b5">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="f73daf99-e281-41dc-87d9-f257045a8146">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="0affebd5-561c-497c-9491-338dce8905e9">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.107" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="84d3c99c-9ae0-4d15-8338-ece1d9a04125">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="39c10a5f-6007-4268-a337-da0f1c17c553">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="50c39df9-0b72-4b14-96ca-356d0dc32f1c">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:         <nova:port uuid="9d81600b-d6e0-4715-9c00-f24f7a2d8fcb">
Apr 11 17:04:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 17:04:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:04:37 user nova-compute[71063]:       </nova:ports>
Apr 11 17:04:37 user nova-compute[71063]:     </nova:instance>
Apr 11 17:04:37 user nova-compute[71063]:   </metadata>
Apr 11 17:04:37 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:04:37 user nova-compute[71063]:     <system>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="serial">fc8f8805-6d61-45a5-b56f-d2c0b107e9c1</entry>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="uuid">fc8f8805-6d61-45a5-b56f-d2c0b107e9c1</entry>
Apr 11 17:04:37 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:04:37 user nova-compute[71063]:     </system>
Apr 11 17:04:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:04:37 user nova-compute[71063]:   <os>
Apr 11 17:04:37 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:04:37 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:04:37 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:04:37 user nova-compute[71063]:   </os>
Apr 11 17:04:37 user nova-compute[71063]:   <features>
Apr 11 17:04:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:04:37 user nova-compute[71063]:     <apic/>
Apr 11 17:04:37 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:04:37 user nova-compute[71063]:   </features>
Apr 11 17:04:37 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:04:37 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:04:37 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:04:37 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:04:37 user nova-compute[71063]:   </clock>
Apr 11 17:04:37 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:04:37 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:04:37 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:04:37 user nova-compute[71063]:   </cpu>
Apr 11 17:04:37 user nova-compute[71063]:   <devices>
Apr 11 17:04:37 user nova-compute[71063]:     <disk type="file" device="cdrom">
Apr 11 17:04:37 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 17:04:37 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/disk.config"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="hda" bus="ide"/>
Apr 11 17:04:37 user nova-compute[71063]:     </disk>
Apr 11 17:04:37 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:37 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:37 user nova-compute[71063]:       <source dev="/dev/sdc"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <serial>ef3cc231-2504-4ee1-a0e8-daabd3795b23</serial>
Apr 11 17:04:37 user nova-compute[71063]:     </disk>
Apr 11 17:04:37 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:37 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:37 user nova-compute[71063]:       <source dev="/dev/sde"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <serial>a7454087-e7d4-4c56-a159-187cdd2dc184</serial>
Apr 11 17:04:37 user nova-compute[71063]:     </disk>
Apr 11 17:04:37 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:04:37 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:04:37 user nova-compute[71063]:       <source dev="/dev/sdg"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="vdc" bus="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <serial>b187ea12-9922-4398-a612-60259900feee</serial>
Apr 11 17:04:37 user nova-compute[71063]:     </disk>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:49:8a:31"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tapdfdf099d-90"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:e1:f5:35"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tapf73daf99-e2"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:ee:5c:5d"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tap0affebd5-56"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:54:1a:0e"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tap84d3c99c-9a"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:a9:d3:ed"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tap39c10a5f-60"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:f9:cc:7f"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tap50c39df9-0b"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:04:37 user nova-compute[71063]:       <mac address="fa:16:3e:12:0c:bc"/>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:04:37 user nova-compute[71063]:       <target dev="tap9d81600b-d6"/>
Apr 11 17:04:37 user nova-compute[71063]:     </interface>
Apr 11 17:04:37 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:04:37 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/console.log" append="off"/>
Apr 11 17:04:37 user nova-compute[71063]:     </serial>
Apr 11 17:04:37 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:04:37 user nova-compute[71063]:     <video>
Apr 11 17:04:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:04:37 user nova-compute[71063]:     </video>
Apr 11 17:04:37 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:04:37 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:04:37 user nova-compute[71063]:     </rng>
Apr 11 17:04:37 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:04:37 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:04:37 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:04:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:04:37 user nova-compute[71063]:   </devices>
Apr 11 17:04:37 user nova-compute[71063]: </domain>
Apr 11 17:04:37 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdf099d-90, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfdf099d-90, col_values=(('external_ids', {'iface-id': 'dfdf099d-908f-40d1-937c-cfa70a5b38b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:8a:31', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90')
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf73daf99-e2, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf73daf99-e2, col_values=(('external_ids', {'iface-id': 'f73daf99-e281-41dc-87d9-f257045a8146', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f5:35', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2')
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0affebd5-56, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0affebd5-56, col_values=(('external_ids', {'iface-id': '0affebd5-561c-497c-9491-338dce8905e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:5c:5d', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56')
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d3c99c-9a, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84d3c99c-9a, col_values=(('external_ids', {'iface-id': '84d3c99c-9ae0-4d15-8338-ece1d9a04125', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:1a:0e', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a')
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39c10a5f-60, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39c10a5f-60, col_values=(('external_ids', {'iface-id': '39c10a5f-6007-4268-a337-da0f1c17c553', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:d3:ed', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60')
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c39df9-0b, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50c39df9-0b, col_values=(('external_ids', {'iface-id': '50c39df9-0b72-4b14-96ca-356d0dc32f1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:cc:7f', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b')
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:04:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d81600b-d6, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d81600b-d6, col_values=(('external_ids', {'iface-id': '9d81600b-d6e0-4715-9c00-f24f7a2d8fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:0c:bc', 'vm-uuid': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:38 user nova-compute[71063]: WARNING nova.compute.manager [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance with vm_state building and task_state spawning.
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: INFO os_vif [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6')
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] No BDM found with device name hda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] No VIF found with MAC fa:16:3e:49:8a:31, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] No VIF found with MAC fa:16:3e:a9:d3:ed, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:04:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Using config drive
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Creating config drive at /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/disk.config
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfqd4ag0m {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfqd4ag0m" returned: 0 in 0.058s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:38 user nova-compute[71063]: WARNING nova.compute.manager [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance with vm_state building and task_state spawning.
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:40 user nova-compute[71063]: WARNING nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance with vm_state building and task_state spawning.
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:40 user nova-compute[71063]: WARNING nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b for instance with vm_state building and task_state spawning.
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:40 user nova-compute[71063]: WARNING nova.compute.manager [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b for instance with vm_state building and task_state spawning.
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:41 user nova-compute[71063]: WARNING nova.compute.manager [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance with vm_state building and task_state spawning.
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:42 user nova-compute[71063]: WARNING nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance with vm_state building and task_state spawning.
Apr 11 17:04:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:42 user nova-compute[71063]: WARNING nova.compute.manager [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance with vm_state building and task_state spawning.
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:43 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance with vm_state building and task_state spawning.
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232684.2939165, 4b822b32-bf4e-43e4-9024-32318a7db4ee => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] VM Resumed (Lifecycle Event)
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance spawned successfully.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232684.2955375, 4b822b32-bf4e-43e4-9024-32318a7db4ee => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] VM Started (Lifecycle Event)
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Took 15.26 seconds to spawn the instance on the hypervisor.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:44 user nova-compute[71063]: WARNING nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 for instance with vm_state building and task_state spawning.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:44 user nova-compute[71063]: WARNING nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 for instance with vm_state building and task_state spawning.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:44 user nova-compute[71063]: WARNING nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance with vm_state building and task_state spawning.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:44 user nova-compute[71063]: WARNING nova.compute.manager [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance with vm_state building and task_state spawning.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: INFO nova.compute.manager [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Took 33.61 seconds to build instance.
Apr 11 17:04:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.762s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:45 user nova-compute[71063]: WARNING nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance with vm_state building and task_state spawning.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:45 user nova-compute[71063]: WARNING nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance with vm_state building and task_state spawning.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:04:45 user nova-compute[71063]: WARNING nova.compute.manager [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance with vm_state building and task_state spawning.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232685.5678484, fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] VM Resumed (Lifecycle Event)
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance spawned successfully.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232685.5681684, fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] VM Started (Lifecycle Event)
Apr 11 17:04:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Took 16.35 seconds to spawn the instance on the hypervisor.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:04:45 user nova-compute[71063]: INFO nova.compute.manager [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Took 34.31 seconds to build instance.
Apr 11 17:04:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.427s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:04:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:04:59 user nova-compute[71063]: INFO nova.compute.manager [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Rescuing
Apr 11 17:04:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:04:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:04:59 user nova-compute[71063]: DEBUG nova.network.neutron [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-changed-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing instance network info cache due to event network-changed-34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG nova.network.neutron [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing network info cache for port 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance destroyed successfully.
Apr 11 17:05:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Attempting rescue
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:05:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Creating image(s)
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue" returned: 0 in 0.068s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start _get_guest_xml network_info=[{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:0d:c9:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'numa_topology' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:05:01 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242455481',display_name='tempest-ServerRescueNegativeTestJSON-server-1242455481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242455481',id=3,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-ia8pkgh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:32Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=58e3bca8-f38a-45d1-98c2-06391f9f31fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:0d:c9:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:0d:c9:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.network.neutron [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updated VIF entry in instance network info cache for port 34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.network.neutron [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:05:01 user nova-compute[71063]:   <uuid>58e3bca8-f38a-45d1-98c2-06391f9f31fd</uuid>
Apr 11 17:05:01 user nova-compute[71063]:   <name>instance-00000003</name>
Apr 11 17:05:01 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:05:01 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:05:01 user nova-compute[71063]:   <metadata>
Apr 11 17:05:01 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:05:01 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1242455481</nova:name>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:05:01</nova:creationTime>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:05:01 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:05:01 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:owner>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:05:01 user nova-compute[71063]:       </nova:owner>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:05:01 user nova-compute[71063]:       <nova:ports>
Apr 11 17:05:01 user nova-compute[71063]:         <nova:port uuid="153bd902-5486-49d7-8f56-9ac648664124">
Apr 11 17:05:01 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 17:05:01 user nova-compute[71063]:         </nova:port>
Apr 11 17:05:01 user nova-compute[71063]:       </nova:ports>
Apr 11 17:05:01 user nova-compute[71063]:     </nova:instance>
Apr 11 17:05:01 user nova-compute[71063]:   </metadata>
Apr 11 17:05:01 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:05:01 user nova-compute[71063]:     <system>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="serial">58e3bca8-f38a-45d1-98c2-06391f9f31fd</entry>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="uuid">58e3bca8-f38a-45d1-98c2-06391f9f31fd</entry>
Apr 11 17:05:01 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:05:01 user nova-compute[71063]:     </system>
Apr 11 17:05:01 user nova-compute[71063]:   </sysinfo>
Apr 11 17:05:01 user nova-compute[71063]:   <os>
Apr 11 17:05:01 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:05:01 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:05:01 user nova-compute[71063]:   </os>
Apr 11 17:05:01 user nova-compute[71063]:   <features>
Apr 11 17:05:01 user nova-compute[71063]:     <acpi/>
Apr 11 17:05:01 user nova-compute[71063]:     <apic/>
Apr 11 17:05:01 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:05:01 user nova-compute[71063]:   </features>
Apr 11 17:05:01 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:05:01 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:05:01 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:05:01 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:05:01 user nova-compute[71063]:   </clock>
Apr 11 17:05:01 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:05:01 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:05:01 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:05:01 user nova-compute[71063]:   </cpu>
Apr 11 17:05:01 user nova-compute[71063]:   <devices>
Apr 11 17:05:01 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:05:01 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:05:01 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue"/>
Apr 11 17:05:01 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:05:01 user nova-compute[71063]:     </disk>
Apr 11 17:05:01 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:05:01 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:05:01 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk"/>
Apr 11 17:05:01 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:05:01 user nova-compute[71063]:     </disk>
Apr 11 17:05:01 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:05:01 user nova-compute[71063]:       <mac address="fa:16:3e:0d:c9:1a"/>
Apr 11 17:05:01 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:05:01 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:05:01 user nova-compute[71063]:       <target dev="tap153bd902-54"/>
Apr 11 17:05:01 user nova-compute[71063]:     </interface>
Apr 11 17:05:01 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:05:01 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/console.log" append="off"/>
Apr 11 17:05:01 user nova-compute[71063]:     </serial>
Apr 11 17:05:01 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:05:01 user nova-compute[71063]:     <video>
Apr 11 17:05:01 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:05:01 user nova-compute[71063]:     </video>
Apr 11 17:05:01 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:05:01 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:05:01 user nova-compute[71063]:     </rng>
Apr 11 17:05:01 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:05:01 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:05:01 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:05:01 user nova-compute[71063]:     </memballoon>
Apr 11 17:05:01 user nova-compute[71063]:   </devices>
Apr 11 17:05:01 user nova-compute[71063]: </domain>
Apr 11 17:05:01 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance destroyed successfully.
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:0d:c9:1a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:02 user nova-compute[71063]: INFO nova.compute.manager [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] instance snapshotting
Apr 11 17:05:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Beginning live snapshot process
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:02 user nova-compute[71063]: WARNING nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state active and task_state rescuing.
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:02 user nova-compute[71063]: WARNING nova.compute.manager [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state active and task_state rescuing.
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab.delta 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab.delta 1073741824" returned: 0 in 0.084s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 17:05:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71063) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 17:05:02 user nova-compute[71063]: INFO nova.virt.libvirt.host [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] UEFI support detected
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-changed-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Refreshing instance network info cache due to event network-changed-6b20a003-d501-4958-9c8c-567343698e97. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Refreshing network info cache for port 6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:05:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updated VIF entry in instance network info cache for port 6b20a003-d501-4958-9c8c-567343698e97. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lazy-loading 'flavor' on Instance uuid 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab.delta /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab.delta /opt/stack/data/nova/instances/snapshots/tmpy8lrbozy/869d0927d1a548ae907442108c73a2ab" returned: 0 in 0.312s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Snapshot extracted, beginning image upload
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:04 user nova-compute[71063]: WARNING nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state active and task_state rescuing.
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:04 user nova-compute[71063]: WARNING nova.compute.manager [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state active and task_state rescuing.
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:04 user nova-compute[71063]: INFO nova.compute.manager [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Attaching volume 9a328310-4c85-49de-a84c-330dab872557 to /dev/vdb
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG os_brick.utils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a760299-b63a-4da6-abc0-eb60c8526942]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb10204-aac5-40e8-9b8d-2ddc2ca64ccf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba8f8b6-75e1-446c-b8d5-ade1068a8c1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac56b3-ce99-4dbb-9214-9caaee2d4d85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:05 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9089ad0b-1c80-411f-b917-6bbc4f4b8784]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG os_brick.utils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Updating existing volume attachment record: 90872cde-c462-4323-b8dc-d48ead6ce46b {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:05 user nova-compute[71063]: INFO nova.compute.manager [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] instance snapshotting
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Beginning live snapshot process
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72.delta 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 58e3bca8-f38a-45d1-98c2-06391f9f31fd due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232705.9847505, 58e3bca8-f38a-45d1-98c2-06391f9f31fd => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:05:06 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] VM Resumed (Lifecycle Event)
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72.delta 1073741824" returned: 0 in 0.052s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232705.986829, 58e3bca8-f38a-45d1-98c2-06391f9f31fd => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:05:06 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] VM Started (Lifecycle Event)
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] COPY block job progress, current cursor: 2555904 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Snapshot image upload complete
Apr 11 17:05:07 user nova-compute[71063]: INFO nova.compute.manager [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Took 5.22 seconds to snapshot the instance on the hypervisor.
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 17:05:07 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72.delta /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72.delta /opt/stack/data/nova/instances/snapshots/tmpvr46w03o/503a5c85318a45dd9d0f219678235c72" returned: 0 in 0.187s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Snapshot extracted, beginning image upload
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:05:09 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:05:09 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=6885MB free_disk=26.624176025390625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRUklgOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:09 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc070dd-7776-44d0-a37f-66d7f3bb03e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:09 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d4e46-b18b-4b17-8723-3450a9753ad5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557] added
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3bb402-16e4-497d-8c45-b86c5d32ff41]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70b7d64-c929-46f4-8e40-66e5d3fea307]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRUklgOq {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRUklgOq" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6fb61-7224-4f24-aa42-f53c9b392a72]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRUklgOq'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb5aed-35f1-4d33-a0c0-a2ce7945c547]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[62653b69-053f-4fe9-b911-d36b3931522e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bca3a0-c35c-4bf2-91cf-42fa51c35eb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260]
Apr 11 17:05:09 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b26ab-8a4f-47f0-add0-0617cc40a3ff]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e4e1c-3c23-40f7-85f5-8ebb4d2ffe81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:09 user nova-compute[71063]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)
Apr 11 17:05:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc49cfd-eb78-42e1-b5ac-eaec6aa9395f]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRUklgOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Snapshot image upload complete
Apr 11 17:05:10 user nova-compute[71063]: INFO nova.compute.manager [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Took 5.01 seconds to snapshot the instance on the hypervisor.
Apr 11 17:05:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23664383232396433', 'path': '/dev/sdh'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664383232396433', 'path': '/dev/sdh'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:10 user nova-compute[71063]: DEBUG nova.objects.instance [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lazy-loading 'flavor' on Instance uuid 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:05:10 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:10 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:05:10 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:10 user nova-compute[71063]:   <serial>9a328310-4c85-49de-a84c-330dab872557</serial>
Apr 11 17:05:10 user nova-compute[71063]: </disk>
Apr 11 17:05:10 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:05:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] No VIF found with MAC fa:16:3e:c4:96:0a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.633s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-changed-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Refreshing instance network info cache due to event network-changed-8b4b45a7-1e14-4c93-a6a9-fe814512cef2. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Refreshing network info cache for port 8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:12 user nova-compute[71063]: INFO nova.compute.manager [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Terminating instance
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updated VIF entry in instance network info cache for port 8b4b45a7-1e14-4c93-a6a9-fe814512cef2. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-unplugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] No waiting events found dispatching network-vif-unplugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-unplugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Instance destroyed successfully.
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lazy-loading 'resources' on Instance uuid 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1282492333',display_name='tempest-DeleteServersTestJSON-server-1282492333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1282492333',id=5,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e0fe3df39a64a39934d199c01985777',ramdisk_id='',reservation_id='r-a12k56eh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1700911607',owner_user_name='tempest-DeleteServersTestJSON-1700911607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:03:33Z,user_data=None,user_id='c74611f9b01a45ef8cfbb50fa9b06cc8',uuid=6687cdc1-6ab3-4e6d-b4a4-e03772606c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converting VIF {"id": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "address": "fa:16:3e:c4:96:0a", "network": {"id": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1191052659-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e0fe3df39a64a39934d199c01985777", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b56bc1c-c0", "ovs_interfaceid": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_vif [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b56bc1c-c0, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:05:13 user nova-compute[71063]: INFO os_vif [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:96:0a,bridge_name='br-int',has_traffic_filtering=True,id=5b56bc1c-c00c-4398-ad90-9dc3b8c71f20,network=Network(9c9850a3-bc74-40ff-896b-4fa8cb68b5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b56bc1c-c0')
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRUklgOq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9165da24-62ce-47b2-9e66-239bddc89c69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:05:13 user nova-compute[71063]: No targets found.
Apr 11 17:05:13 user nova-compute[71063]: iSNS:
Apr 11 17:05:13 user nova-compute[71063]: No targets found.
Apr 11 17:05:13 user nova-compute[71063]: STATIC:
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:05:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:13 user nova-compute[71063]: FIRMWARE:
Apr 11 17:05:13 user nova-compute[71063]: No targets found.
Apr 11 17:05:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:05:13 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:05:13 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.041s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f97e57-5f9d-4e21-9521-1e775e592463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[130cd7e5-89d6-434a-bfe1-485332d866db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:13 user nova-compute[71063]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 (non-flash)
Apr 11 17:05:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb429a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557'): ({'sdh'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Removing single pathed devices sdh {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85a571-bf65-43bb-9a07-27bfa8ae3405]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d14a4-bf0a-4708-b437-6409ff57dae1]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Flushing IO for device /dev/sdh {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c1ebe5-7b4f-4b4d-b533-67f6fa6e84ed]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9369c54f-46ac-445e-990e-ae6e3d1c59ba]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1e4365-3496-42ef-88b6-15d40403c61c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[15722888-c7c0-4a0d-a781-64661f3ef747]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260]
Apr 11 17:05:13 user nova-compute[71063]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a328310-4c85-49de-a84c-330dab872557 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6131d19-e58c-4ed6-8ff3-43e239b16ca6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.500s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] <== disconnect_volume: return (501ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:05:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Deleting instance files /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41_del
Apr 11 17:05:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Deletion of /opt/stack/data/nova/instances/6687cdc1-6ab3-4e6d-b4a4-e03772606c41_del complete
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:13 user nova-compute[71063]: INFO nova.compute.manager [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Attaching volume c9628077-d981-481d-a434-92ba15259efd to /dev/vdb
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.utils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:14 user nova-compute[71063]: INFO nova.compute.manager [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Took 1.44 seconds to destroy the instance on the hypervisor.
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9ffb7f-034d-4bee-8013-1e9c6494d7a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ea39f-5090-49f1-9f69-10a56cc3285f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e6b79-ec08-40ad-a517-cf1a739b57d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a10dea-ff54-465c-940b-0c255b759d2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:14 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afec5e8-2811-4f0e-9a82-3513be1fc831]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG os_brick.utils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating existing volume attachment record: 04a999a1-2049-4a01-a20c-8ff07115192d {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:05:14 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:14 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Took 0.64 seconds to deallocate network for instance.
Apr 11 17:05:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Acquiring lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] No waiting events found dispatching network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:15 user nova-compute[71063]: WARNING nova.compute.manager [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received unexpected event network-vif-plugged-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance with vm_state active and task_state deleting.
Apr 11 17:05:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Received event network-vif-deleted-5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:15 user nova-compute[71063]: INFO nova.compute.manager [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Took 0.84 seconds to detach 1 volumes for instance.
Apr 11 17:05:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:15 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:05:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:05:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:16 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Deleted allocations for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41
Apr 11 17:05:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "6687cdc1-6ab3-4e6d-b4a4-e03772606c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.568s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:18 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:18 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:18 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938206e-c49f-4b29-80dd-424f4d2594c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:18 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[95de162f-b8e6-435c-9b0f-44544dffd62d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd] added
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d976d3-6453-46e9-9d1a-97a26b285722]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90329922-4185-4a01-a525-24c3a71dde2f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QahesofS {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QahesofS" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebbc9d6-aecf-4d3c-8d27-a817d7fdb9f0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QahesofS'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09a7c5b-a6c9-43b2-973d-1b0edac02445]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e747b426-9b70-4adf-bfed-0a2faead1a2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14157c6d-eba1-470b-85cb-650d24fc10c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]
Apr 11 17:05:18 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6663cf06-c0b1-45cb-867e-00dc6d4a628f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad50dc38-5edb-4cec-9c54-15e2eb4b71bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:18 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aefdec-985a-404d-a67b-a4dbbaa1a7c4]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23865373535356430', 'path': '/dev/sdh'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865373535356430', 'path': '/dev/sdh'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:19 user nova-compute[71063]: DEBUG nova.objects.instance [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:05:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:19 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:05:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:19 user nova-compute[71063]:   <serial>c9628077-d981-481d-a434-92ba15259efd</serial>
Apr 11 17:05:19 user nova-compute[71063]: </disk>
Apr 11 17:05:19 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No VIF found with MAC fa:16:3e:42:9e:29, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.335s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-changed-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Refreshing instance network info cache due to event network-changed-c93de33f-8a35-40fb-bb48-f717e6fb90f6. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Acquiring lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Acquired lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Refreshing network info cache for port c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71063) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG nova.objects.instance [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:21 user nova-compute[71063]: WARNING nova.compute.manager [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state active and task_state powering-off.
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updated VIF entry in instance network info cache for port c93de33f-8a35-40fb-bb48-f717e6fb90f6. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updating instance_info_cache with network_info: [{"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Releasing lock "refresh_cache-cdd4a3a0-35a6-4f62-abc1-6a806ab62783" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance destroyed successfully.
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.884s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'flavor' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:22 user nova-compute[71063]: INFO nova.compute.manager [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Attaching volume c0f3da1e-ec0b-4443-8e26-d9db454344ab to /dev/sdc
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.utils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5f499-eedb-4c06-afda-b1f7f8505ade]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[905322ff-0171-49c5-bbf9-379b40fbac4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b818154f-aae7-4a88-8886-8c1c7245737e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b9f90d-39e3-4b4b-8039-18ede9f9b39b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-changed-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Refreshing instance network info cache due to event network-changed-68bea989-7c25-4d4d-aa6d-e4fe977ebb93. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Acquiring lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Acquired lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Refreshing network info cache for port 68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:22 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7199aa6-a256-47b1-9ca2-dec368966f3e]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG os_brick.utils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:22 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updating existing volume attachment record: c222ec1d-69f3-415e-80ae-14dec964c315 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:23 user nova-compute[71063]: WARNING nova.compute.manager [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updated VIF entry in instance network info cache for port 68bea989-7c25-4d4d-aa6d-e4fe977ebb93. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating instance_info_cache with network_info: [{"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Releasing lock "refresh_cache-2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'flavor' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:23 user nova-compute[71063]: INFO nova.compute.manager [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Attaching volume 479230cb-0e0b-47ce-b9f6-cff7797f61d7 to /dev/vdb
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1af954-ebf3-43b0-87be-b2fc96fd4c42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5515a720-350e-4ea0-b547-aae0dae73001]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dcda21-d581-449a-995a-2dbf2c47d35a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf307e-dfd6-4676-879b-7dc4eef54b2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:23 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2da25c-fb10-4751-bdf0-aacf86151f74]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:23 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating existing volume attachment record: deef282c-6f07-4550-ac31-a580d9edf6a9 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtmHQSvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:26 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:26 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:26 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a4179d-0f14-4b1a-9210-e2622329d2b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:26 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d0074-51b6-44b4-8d8e-619ef5c21225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab] added
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a000d882-ae41-4667-ac3f-046540c0ec61]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b50f4a9-fe89-4ca5-928c-a2357225c45d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtmHQSvJ {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DtmHQSvJ" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3c806c-a0b1-4ed5-99f2-b6fc23eb7dc3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DtmHQSvJ'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ad685a-294d-4288-bb99-582f3b91e21e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b7910-d1e0-4eae-af33-342d4e9e867b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7798c00-a86c-4eb5-959f-4e926dd78581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260]
Apr 11 17:05:26 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8823ca15-0543-4c12-bd55-57763ac540ed]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2376cd4-f676-42bd-b915-75b9e1e7abee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:26 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:26 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50430e3-7d2d-4d31-a9a6-87815cbb97f7]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:26 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtmHQSvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvQDoWwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26464306134623037', 'path': '/dev/sdi'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306134623037', 'path': '/dev/sdi'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.035s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:28 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:28 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'flavor' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed291958-d94f-4ad3-b291-73cbbacde4c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:28 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ee6de4-dd79-4ed5-a631-847571c188c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7] added
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:05:28 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:28 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:05:28 user nova-compute[71063]:   <target dev="sdc" bus="scsi"/>
Apr 11 17:05:28 user nova-compute[71063]:   <serial>c0f3da1e-ec0b-4443-8e26-d9db454344ab</serial>
Apr 11 17:05:28 user nova-compute[71063]:   <address type="drive" controller="0" unit="2"/>
Apr 11 17:05:28 user nova-compute[71063]: </disk>
Apr 11 17:05:28 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6d3f0-2109-4697-9fd8-16198388f798]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cd156b-82d4-43f4-a656-0cc4d204a804]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvQDoWwq {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jvQDoWwq" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cee04f-2061-4580-8b73-63b115b8a535]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jvQDoWwq'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ff78d-f910-4b03-a7c5-20a8d33b2802]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908bcb3-eadf-4fa7-a939-37643ba00710]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232713.2013204, 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:05:28 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] VM Stopped (Lifecycle Event)
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-405ff61c-d469-4da5-8b2d-1d645a16683c None None] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca519f39-8eb4-4e40-bab0-2807e3cedabb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260]
Apr 11 17:05:28 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9d103-f2e0-42b6-91fa-be0d21105a7a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d62d0-2288-4c9b-9c19-89f6591cbf44]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:28 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a29491-6062-4258-91f1-dfef0b743f30]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No BDM found with device name sda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] No VIF found with MAC fa:16:3e:b6:28:09, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.421s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:29 user nova-compute[71063]: INFO nova.compute.manager [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Detaching volume c0f3da1e-ec0b-4443-8e26-d9db454344ab
Apr 11 17:05:29 user nova-compute[71063]: INFO nova.virt.block_device [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Attempting to driver detach volume c0f3da1e-ec0b-4443-8e26-d9db454344ab from mountpoint /dev/sdc
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Attempting to detach device sdc from instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:05:29 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:29 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:05:29 user nova-compute[71063]:   <target dev="sdc" bus="scsi"/>
Apr 11 17:05:29 user nova-compute[71063]:   <serial>c0f3da1e-ec0b-4443-8e26-d9db454344ab</serial>
Apr 11 17:05:29 user nova-compute[71063]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 17:05:29 user nova-compute[71063]: </disk>
Apr 11 17:05:29 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:05:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Successfully detached device sdc from instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 from the persistent domain config.
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:05:29 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:29 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:05:29 user nova-compute[71063]:   <target dev="sdc" bus="scsi"/>
Apr 11 17:05:29 user nova-compute[71063]:   <serial>c0f3da1e-ec0b-4443-8e26-d9db454344ab</serial>
Apr 11 17:05:29 user nova-compute[71063]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 17:05:29 user nova-compute[71063]: </disk>
Apr 11 17:05:29 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvQDoWwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23436353761626437', 'path': '/dev/sdj'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436353761626437', 'path': '/dev/sdj'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'flavor' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:05:29 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:29 user nova-compute[71063]:   <source dev="/dev/sdj"/>
Apr 11 17:05:29 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:29 user nova-compute[71063]:   <serial>479230cb-0e0b-47ce-b9f6-cff7797f61d7</serial>
Apr 11 17:05:29 user nova-compute[71063]: </disk>
Apr 11 17:05:29 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232729.6792378, cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:05:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Successfully detached device sdc from instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 from the live domain config.
Apr 11 17:05:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DtmHQSvJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48a3ea2-c455-4ac2-9353-3e7e01f1cc74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:05:29 user nova-compute[71063]: No targets found.
Apr 11 17:05:29 user nova-compute[71063]: iSNS:
Apr 11 17:05:29 user nova-compute[71063]: No targets found.
Apr 11 17:05:29 user nova-compute[71063]: STATIC:
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:05:29 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:29 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:29 user nova-compute[71063]: FIRMWARE:
Apr 11 17:05:29 user nova-compute[71063]: No targets found.
Apr 11 17:05:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:05:29 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:05:29 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c76c08-2bff-4889-b978-5aa868a57e73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3459c00d-656f-41ac-b99a-8938050a849d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:29 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbebf518b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab'): ({'sdi'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Removing single pathed devices sdi {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba4404-8214-4f4b-abf4-35aa85b92b15]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[80909a79-6bc8-4d98-9a32-1a23320c73b1]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Flushing IO for device /dev/sdi {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ccfcb0-08be-4190-8756-154020f63f7c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe9401a-ae98-4290-917e-99a92ce6ce78]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[955eb8ab-d3f6-4584-a174-7cd15667cf61]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[99046396-91ef-4b78-8ed7-540f346d5dc3]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260]
Apr 11 17:05:30 user nova-compute[71063]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0f3da1e-ec0b-4443-8e26-d9db454344ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef205b-3a5c-4cc5-bacb-c59a65fbf380]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] <== disconnect_volume: return (359ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No VIF found with MAC fa:16:3e:70:3f:0d, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.533s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'flavor' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-changed-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Refreshing instance network info cache due to event network-changed-3bc601e8-552e-473e-abe3-24e32a78188f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Acquiring lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Acquired lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Refreshing network info cache for port 3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG nova.objects.instance [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'flavor' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:31 user nova-compute[71063]: INFO nova.compute.manager [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Terminating instance
Apr 11 17:05:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:31 user nova-compute[71063]: INFO nova.compute.manager [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attaching volume 1db9739e-54c3-4cb3-b225-7fb33f46160d to /dev/vdb
Apr 11 17:05:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:31 user nova-compute[71063]: DEBUG os_brick.utils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.compute.manager [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Detaching volume 479230cb-0e0b-47ce-b9f6-cff7797f61d7
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd06c3-43f9-4eea-a4cd-ee1b3ea07ec1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9163ca-3956-4a7d-943e-f2ae1e643144]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0688edc0-eb7c-4bc7-bd97-c0b78312222c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a308070f-1713-43cf-8ae8-9af4cb1e7cb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.network.neutron [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updated VIF entry in instance network info cache for port 3bc601e8-552e-473e-abe3-24e32a78188f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.network.neutron [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updating instance_info_cache with network_info: [{"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.block_device [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Attempting to driver detach volume 479230cb-0e0b-47ce-b9f6-cff7797f61d7 from mountpoint /dev/vdb
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Releasing lock "refresh_cache-180c44cc-172d-4e8c-b4ec-6259e775c404" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-unplugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] No waiting events found dispatching network-vif-unplugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-unplugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:32 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5577e-b5fb-4721-a9ac-bf97578f054f]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.utils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updating existing volume attachment record: 95e2c7e1-f8f8-4132-af91-e694fdae8c68 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Attempting to detach device vdb from instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:05:32 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:32 user nova-compute[71063]:   <source dev="/dev/sdj"/>
Apr 11 17:05:32 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:32 user nova-compute[71063]:   <serial>479230cb-0e0b-47ce-b9f6-cff7797f61d7</serial>
Apr 11 17:05:32 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:05:32 user nova-compute[71063]: </disk>
Apr 11 17:05:32 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully detached device vdb from instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e from the persistent domain config.
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:05:32 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:32 user nova-compute[71063]:   <source dev="/dev/sdj"/>
Apr 11 17:05:32 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:32 user nova-compute[71063]:   <serial>479230cb-0e0b-47ce-b9f6-cff7797f61d7</serial>
Apr 11 17:05:32 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:05:32 user nova-compute[71063]: </disk>
Apr 11 17:05:32 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232732.7737172, 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully detached device vdb from instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e from the live domain config.
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jvQDoWwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:32 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Instance destroyed successfully.
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'resources' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-790493278',display_name='tempest-AttachSCSIVolumeTestJSON-server-790493278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-790493278',id=8,image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYkCAEQ+bl11uHPZVQKbgG6myknafTn09U4qfFdXo5BEH//wtE/q6s8OBga0Azbc9wMj6qkFejLKmdVWResnP4PMs0NtC25KI97YqzyPazY0r+rOz1TGx6RxCixovI8Ow==',key_name='tempest-keypair-208324507',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c7d76a8d4544e2b84d52eebb6d4b5b1',ramdisk_id='',reservation_id='r-odsbdqxw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6bd1738-b766-4c42-8e29-ec27c8534889',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1826674867',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1826674867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:03:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c4b1a17c7804cd4ba2ad825e0cc2dd0',uuid=cdd4a3a0-35a6-4f62-abc1-6a806ab62783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converting VIF {"id": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "address": "fa:16:3e:b6:28:09", "network": {"id": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-450357314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c7d76a8d4544e2b84d52eebb6d4b5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93de33f-8a", "ovs_interfaceid": "c93de33f-8a35-40fb-bb48-f717e6fb90f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_vif [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0cafcf-b9f3-4a46-8dc1-5996fdb76acb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:05:32 user nova-compute[71063]: No targets found.
Apr 11 17:05:32 user nova-compute[71063]: iSNS:
Apr 11 17:05:32 user nova-compute[71063]: No targets found.
Apr 11 17:05:32 user nova-compute[71063]: STATIC:
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:05:32 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:32 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:32 user nova-compute[71063]: FIRMWARE:
Apr 11 17:05:32 user nova-compute[71063]: No targets found.
Apr 11 17:05:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:05:32 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:05:32 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93de33f-8a, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:32 user nova-compute[71063]: INFO os_vif [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:28:09,bridge_name='br-int',has_traffic_filtering=True,id=c93de33f-8a35-40fb-bb48-f717e6fb90f6,network=Network(ffb7e852-2910-4f4f-9c26-193dd9dc6bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93de33f-8a')
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Deleting instance files /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783_del
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Deletion of /opt/stack/data/nova/instances/cdd4a3a0-35a6-4f62-abc1-6a806ab62783_del complete
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c0109-4381-4bc2-bec3-acdf76824826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fac569-a634-45bf-8ba3-513a2fb07324]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:32 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb4119ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7'): ({'sdj'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Removing single pathed devices sdj {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: INFO nova.compute.manager [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ee8d28-3f47-40b7-8970-353b56506417]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec7261-3270-469a-8767-81af5323905f]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flushing IO for device /dev/sdj {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d838ad-ffc1-4b97-b5a8-02e4b6a7e591]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:05:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2432df91-1708-483b-8cfc-b2bb58f7ccba]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] SCSI volumes sdj have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a2ba14-0ddf-49f9-a14d-71f394cf5f82]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[792c3c5c-048a-4e21-8f07-9d3a56298a7b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260]
Apr 11 17:05:33 user nova-compute[71063]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:479230cb-0e0b-47ce-b9f6-cff7797f61d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c45a799-397f-4372-ae3a-d9e44bcae10c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] <== disconnect_volume: return (354ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'flavor' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.974s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:33 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:05:34 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Took 1.10 seconds to deallocate network for instance.
Apr 11 17:05:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-deleted-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Acquiring lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] No waiting events found dispatching network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:05:34 user nova-compute[71063]: WARNING nova.compute.manager [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Received unexpected event network-vif-plugged-c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance with vm_state deleted and task_state None.
Apr 11 17:05:34 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:34 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Deleted allocations for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783
Apr 11 17:05:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "cdd4a3a0-35a6-4f62-abc1-6a806ab62783" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232721.3839345, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:05:36 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Stopped (Lifecycle Event)
Apr 11 17:05:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-663445a7-9000-49b9-82ee-ce816271bc6f None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-663445a7-9000-49b9-82ee-ce816271bc6f None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:36 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:36 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:36 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[757264d9-fe39-498b-a2a3-e25446097669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:36 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[864e361f-9680-4267-a400-e6300427d56e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d] added
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9e600e-beed-400a-9086-3778a1770f77]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a8f7a-8160-4748-b423-0b33aac3706e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMchyYNi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMchyYNi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2804da2-ee07-4186-a290-2c42fa47c773]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMchyYNi'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560ae8f-7522-4ac3-8e40-ed28f14e2bd2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7140a55a-07f6-4722-9b3c-c26d8cb0ca8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250749a-6684-481a-bcc2-3b2ec0fd8a5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]
Apr 11 17:05:36 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e48bbcd-e7d5-4387-82ac-95a2c706ae37]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[187ebfce-abc4-426d-a28c-6ea76ee2526f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:36 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c1af7-fa10-4e29-a0cf-a094b59ab01e]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23766373435333861', 'path': '/dev/sdi'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766373435333861', 'path': '/dev/sdi'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'flavor' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:05:37 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:05:37 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:05:37 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:05:37 user nova-compute[71063]:   <serial>1db9739e-54c3-4cb3-b225-7fb33f46160d</serial>
Apr 11 17:05:37 user nova-compute[71063]: </disk>
Apr 11 17:05:37 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:05:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:05:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] No VIF found with MAC fa:16:3e:90:90:b4, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:05:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.646s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.utils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[07619126-e606-48ca-8704-bc8459a48d3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b99576-0050-45b0-b295-a9d85d828861]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac7a140-8f40-484f-bf10-d64df93ef116]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7739a00-7790-4b4f-ae6f-b533ed7ae2b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:39 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5ff567-aaa6-40ca-84c3-e9227ab56ca6]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:39 user nova-compute[71063]: DEBUG os_brick.utils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:40 user nova-compute[71063]: INFO nova.compute.manager [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Swapping volume 1db9739e-54c3-4cb3-b225-7fb33f46160d for c040dff2-7d01-47a8-b5e8-a7c3d5e7414f
Apr 11 17:05:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'serial': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': '1db9739e-54c3-4cb3-b225-7fb33f46160d', 'serial'} {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:44 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:44 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:44 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0130111c-d602-4c39-a53b-503158d47556]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:44 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a6761-257a-4268-9c45-32373347eb7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f] added
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b526ac99-5050-446b-a97b-444f8e5400a5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[426dec72-7f8e-4945-a1a1-4c69f153ead6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TuDhwrYK {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TuDhwrYK" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7c569b-098e-4984-936d-45665bebd46f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TuDhwrYK'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc716ed-bdb5-4efb-9161-1eae607609e5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be5b2e-6c88-4e01-b9fc-6d34470a0981]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e780bb-6e05-45bf-bf06-d99b732f0b02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260]
Apr 11 17:05:44 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed81ce-b813-4a70-ae4b-b2084bcf64eb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab573dbf-d059-41be-bc9c-32510e516920]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:44 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d24e584-0d38-4709-9d5e-67aee2edff8a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23731623265666665', 'path': '/dev/sdj'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731623265666665', 'path': '/dev/sdj'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:45 user nova-compute[71063]: DEBUG nova.objects.instance [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lazy-loading 'flavor' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 171966464 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 548405248 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:47 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232732.798366, cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:05:47 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] VM Stopped (Lifecycle Event)
Apr 11 17:05:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-062d99fb-1a71-424a-9e32-cf37d898858f None None] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:05:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 743440384 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:49 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8aac38-3150-493f-9c8b-b37e7f705c55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:05:49 user nova-compute[71063]: No targets found.
Apr 11 17:05:49 user nova-compute[71063]: iSNS:
Apr 11 17:05:49 user nova-compute[71063]: No targets found.
Apr 11 17:05:49 user nova-compute[71063]: STATIC:
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:05:49 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:05:49 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:05:49 user nova-compute[71063]: FIRMWARE:
Apr 11 17:05:49 user nova-compute[71063]: No targets found.
Apr 11 17:05:49 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:05:49 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:05:49 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee7700-6d05-4fd2-b62d-14c5306c6f12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[effbade5-990f-4c02-984e-14eee1a23074]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:49 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:49 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:49 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec00997e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d'): ({'sdi'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Removing single pathed devices sdi {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d5bde8-ba9f-412e-8689-8cea54814cdb]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1fccc5-ac80-427f-aa90-b27e9c0b0972]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Flushing IO for device /dev/sdi {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052f318-ae47-4f51-a7b7-f831eec96d72]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c74c166-a0df-49fd-b05e-84c8a3a7a4c5]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89212ad5-3188-4f89-8eac-c038d968aab5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3376668a-9e35-48c1-b6b1-1f2983d39b04]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]
Apr 11 17:05:50 user nova-compute[71063]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d61135-cbd2-4fd9-8f99-5686f96ebb58]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== disconnect_volume: return (351ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'serial'} {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: removing Cinder connection for volume 1db9739e-54c3-4cb3-b225-7fb33f46160d {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: Updating volume 1db9739e-54c3-4cb3-b225-7fb33f46160d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TuDhwrYK", "auth_password": "2WcaDqtLRu3C47", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "c040dff2-7d01-47a8-b5e8-a7c3d5e7414f"}, "status": "reserved", "instance": "180c44cc-172d-4e8c-b4ec-6259e775c404", "attached_at": "", "detached_at": "", "volume_id": "c040dff2-7d01-47a8-b5e8-a7c3d5e7414f", "serial": "c040dff2-7d01-47a8-b5e8-a7c3d5e7414f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'no_device': None, 'attachment_id': 'dc040c33-29a4-4627-9880-1ff47341e5dd'} {{(pid=71063) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 17:05:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.120s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.utils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[48549f2a-8edc-4769-b506-46a267c59051]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c817bb-5202-4f9e-972d-f74932dfce79]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c9114-b8cb-43ab-98d8-2b39c7b3e057]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4708165-0db1-4950-884c-629877313d3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:05:52 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:05:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51b6410-9a4e-4da4-93d1-a4bd4cab5e6b]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:05:52 user nova-compute[71063]: DEBUG os_brick.utils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:52 user nova-compute[71063]: INFO nova.compute.manager [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Swapping volume c040dff2-7d01-47a8-b5e8-a7c3d5e7414f for 1db9739e-54c3-4cb3-b225-7fb33f46160d
Apr 11 17:05:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': '1db9739e-54c3-4cb3-b225-7fb33f46160d', 'serial': '1db9739e-54c3-4cb3-b225-7fb33f46160d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f'}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'serial'} {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:05:56 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:56 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:05:56 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e05626e-591b-48f2-8e74-676857795a44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:05:56 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3071ba-2236-46c0-994a-28878b2e5ead]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d] added
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.113s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[318129bb-23ed-4bbd-a397-66ffa459559d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afbb97b-0935-452c-a3cc-d82cb119b93a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMchyYNi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMchyYNi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09afd171-4f65-4232-9a56-e8d840c917e7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMchyYNi'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[190065d9-9f22-4cd5-9761-d9373e5d44a0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41d2797-0ceb-4f63-8195-507d493afb95]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ded664-df8f-484b-89c4-cb6c16733c4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]
Apr 11 17:05:56 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcbb96f-cfca-480f-ade9-86e670d72180]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd1449f-a13f-4a52-803d-637eae1bd2bd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:05:56 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:05:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[885be062-df62-43ed-95fb-1fa0cb8f9cf3]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:05:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23766373435333861', 'path': '/dev/sdi'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766373435333861', 'path': '/dev/sdi'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lazy-loading 'flavor' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:05:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:05:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 102760448 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:05:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 479199232 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:06:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 658505728 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:06:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 1053818880 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TuDhwrYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'c040dff2-7d01-47a8-b5e8-a7c3d5e7414f': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:01 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bb721d-f81c-41fa-bfc8-5fcb6e20eb9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:01 user nova-compute[71063]: No targets found.
Apr 11 17:06:01 user nova-compute[71063]: iSNS:
Apr 11 17:06:01 user nova-compute[71063]: No targets found.
Apr 11 17:06:01 user nova-compute[71063]: STATIC:
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:01 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:01 user nova-compute[71063]: No targets found.
Apr 11 17:06:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:01 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:01 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847a8f9-45c4-4e42-b78b-e334f7188e1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbcdfce-7c8f-4492-9d2a-3b527e981e4e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec00997e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f'): ({'sdj'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Removing single pathed devices sdj {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-changed-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing instance network info cache due to event network-changed-7320c7cb-cd67-4b96-bcd0-865515f9b472. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Acquiring lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Acquired lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG nova.network.neutron [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Refreshing network info cache for port 7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe59ae7d-ddf5-4bfc-b4ec-9cda46b74018]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[174b8ef1-0263-4018-8d36-6a6be9cd6976]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Flushing IO for device /dev/sdj {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6cfd78-3327-4834-9175-3ebfc8a4f384]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb960793-7e7a-498f-a746-8be127dc8a7d]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] SCSI volumes sdj have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b515655f-6f2c-4500-a317-0de31a9ce484]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd41d2e-8c84-46b7-9af2-ae28a5045eb5]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260]
Apr 11 17:06:02 user nova-compute[71063]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c040dff2-7d01-47a8-b5e8-a7c3d5e7414f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5227de6c-2941-441f-8e67-57e4b651a77e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] <== disconnect_volume: return (374ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '180c44cc-172d-4e8c-b4ec-6259e775c404', 'attached_at': '', 'detached_at': '', 'volume_id': '1db9739e-54c3-4cb3-b225-7fb33f46160d', 'serial'} {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: removing Cinder connection for volume c040dff2-7d01-47a8-b5e8-a7c3d5e7414f {{(pid=71063) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG nova.network.neutron [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updated VIF entry in instance network info cache for port 7320c7cb-cd67-4b96-bcd0-865515f9b472. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG nova.network.neutron [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Releasing lock "refresh_cache-4b822b32-bf4e-43e4-9024-32318a7db4ee" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] swap_volume: Updating volume c040dff2-7d01-47a8-b5e8-a7c3d5e7414f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QMchyYNi", "auth_password": "B5tD2rqdXak0MZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "1db9739e-54c3-4cb3-b225-7fb33f46160d"}, "status": "reserved", "instance": "180c44cc-172d-4e8c-b4ec-6259e775c404", "attached_at": "", "detached_at": "", "volume_id": "1db9739e-54c3-4cb3-b225-7fb33f46160d", "serial": "1db9739e-54c3-4cb3-b225-7fb33f46160d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '1db9739e-54c3-4cb3-b225-7fb33f46160d', 'no_device': None, 'attachment_id': 'a65921b9-f670-450f-9a8f-a5fa9a4f2059'} {{(pid=71063) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.115s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:03 user nova-compute[71063]: INFO nova.compute.manager [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Terminating instance
Apr 11 17:06:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-changed-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing instance network info cache due to event network-changed-dfdf099d-908f-40d1-937c-cfa70a5b38b5. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Acquiring lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Acquired lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Refreshing network info cache for port dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.012s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:04 user nova-compute[71063]: INFO nova.compute.manager [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Terminating instance
Apr 11 17:06:04 user nova-compute[71063]: INFO nova.compute.manager [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Detaching volume 1db9739e-54c3-4cb3-b225-7fb33f46160d
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: INFO nova.virt.block_device [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Attempting to driver detach volume 1db9739e-54c3-4cb3-b225-7fb33f46160d from mountpoint /dev/vdb
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Attempting to detach device vdb from instance 180c44cc-172d-4e8c-b4ec-6259e775c404 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:06:04 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:04 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:06:04 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:06:04 user nova-compute[71063]:   <serial>1db9739e-54c3-4cb3-b225-7fb33f46160d</serial>
Apr 11 17:06:04 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:06:04 user nova-compute[71063]: </disk>
Apr 11 17:06:04 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Successfully detached device vdb from instance 180c44cc-172d-4e8c-b4ec-6259e775c404 from the persistent domain config.
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 180c44cc-172d-4e8c-b4ec-6259e775c404 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:06:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:06:04 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:04 user nova-compute[71063]:   <source dev="/dev/sdi"/>
Apr 11 17:06:04 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:06:04 user nova-compute[71063]:   <serial>1db9739e-54c3-4cb3-b225-7fb33f46160d</serial>
Apr 11 17:06:04 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:06:04 user nova-compute[71063]: </disk>
Apr 11 17:06:04 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232765.8029723, 180c44cc-172d-4e8c-b4ec-6259e775c404 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:06:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Successfully detached device vdb from instance 180c44cc-172d-4e8c-b4ec-6259e775c404 from the live domain config.
Apr 11 17:06:05 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMchyYNi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '1db9739e-54c3-4cb3-b225-7fb33f46160d': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:05 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b57f494-5437-4989-a3e0-51f782697cfb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:05 user nova-compute[71063]: No targets found.
Apr 11 17:06:05 user nova-compute[71063]: iSNS:
Apr 11 17:06:05 user nova-compute[71063]: No targets found.
Apr 11 17:06:05 user nova-compute[71063]: STATIC:
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:05 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:05 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:05 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:05 user nova-compute[71063]: No targets found.
Apr 11 17:06:05 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:05 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:05 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updated VIF entry in instance network info cache for port dfdf099d-908f-40d1-937c-cfa70a5b38b5. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[116a7be2-d0fb-4a41-87b1-f44a9aa3f384]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Releasing lock "refresh_cache-fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6824e1-920e-42f5-a1a1-3dc18569a9e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:05 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:05 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:05 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec17e01f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d'): ({'sdi'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Removing single pathed devices sdi {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[95347406-efc0-4ec2-b22c-5071de92867c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa13d60b-f70b-41bf-8676-65c151ef8797]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Flushing IO for device /dev/sdi {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ba378-3443-43a1-964d-bf323ed0e68c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.062s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef23d28f-9a93-4c7d-95d4-9a0cb91c58c2]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] SCSI volumes sdi have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[689be4f7-eebf-4200-a2f8-053ffbec4507]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13cabfb-121f-4ae9-95de-dbe1e51d3155]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260]
Apr 11 17:06:06 user nova-compute[71063]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db9739e-54c3-4cb3-b225-7fb33f46160d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81a9888-ec3f-4bed-98e9-05e1fb9bfc03]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] <== disconnect_volume: return (461ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:06 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Instance destroyed successfully.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lazy-loading 'resources' on Instance uuid 4b822b32-bf4e-43e4-9024-32318a7db4ee {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7320c7cb-cd, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-f73daf99-e281-41dc-87d9-f257045a8146 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:db:d9,bridge_name='br-int',has_traffic_filtering=True,id=7320c7cb-cd67-4b96-bcd0-865515f9b472,network=Network(ec3dc14b-bb3d-476c-b632-ad7601808691),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7320c7cb-cd')
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4c6824f-e5, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Instance destroyed successfully.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lazy-loading 'resources' on Instance uuid fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-818fbdc6-1f85-4f25-a9a8-99aec719102e for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-818fbdc6-1f85-4f25-a9a8-99aec719102e for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-8a27e645-0909-4786-a624-5d12630f2e1b for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-8a27e645-0909-4786-a624-5d12630f2e1b for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:06 user nova-compute[71063]: WARNING nova.compute.manager [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance with vm_state active and task_state deleting.
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdf099d-90, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:06 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:a5,bridge_name='br-int',has_traffic_filtering=True,id=a4c6824f-e5f7-4f25-81eb-5cc534c99636,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa4c6824f-e5')
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap818fbdc6-1f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8a:31,bridge_name='br-int',has_traffic_filtering=True,id=dfdf099d-908f-40d1-937c-cfa70a5b38b5,network=Network(15ad4720-343d-4440-b8ea-91b96b18416d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdf099d-90')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'flavor' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf73daf99-e2, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c9:3e,bridge_name='br-int',has_traffic_filtering=True,id=818fbdc6-1f85-4f25-a9a8-99aec719102e,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap818fbdc6-1f')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.528s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6dc07d2-c1, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f5:35,bridge_name='br-int',has_traffic_filtering=True,id=f73daf99-e281-41dc-87d9-f257045a8146,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf73daf99-e2')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0affebd5-56, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5c:3c,bridge_name='br-int',has_traffic_filtering=True,id=c6dc07d2-c1e5-44f7-8683-0162519e8613,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6dc07d2-c1')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "8a27e645-0909-4786-a624-5d12630f2e1b", "address": "fa:16:3e:e2:c7:0a", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a27e645-09", "ovs_interfaceid": "8a27e645-0909-4786-a624-5d12630f2e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a27e645-09, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:5c:5d,bridge_name='br-int',has_traffic_filtering=True,id=0affebd5-561c-497c-9491-338dce8905e9,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0affebd5-56')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d3c99c-9a, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c7:0a,bridge_name='br-int',has_traffic_filtering=True,id=8a27e645-0909-4786-a624-5d12630f2e1b,network=Network(51ac13fa-7a9c-45dd-9dd2-6b318da34392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a27e645-09')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99ac8a24-e7, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:1a:0e,bridge_name='br-int',has_traffic_filtering=True,id=84d3c99c-9ae0-4d15-8338-ece1d9a04125,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d3c99c-9a')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "39c10a5f-6007-4268-a337-da0f1c17c553", "address": "fa:16:3e:a9:d3:ed", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c10a5f-60", "ovs_interfaceid": "39c10a5f-6007-4268-a337-da0f1c17c553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.objects.instance [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39c10a5f-60, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:28:a0,bridge_name='br-int',has_traffic_filtering=True,id=99ac8a24-e783-4834-a419-d58b3e288aa4,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99ac8a24-e7')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-457045036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-457045036',id=11,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw==',key_name='tempest-keypair-79124000',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5ab1632b5534eb9b5096d25137bd538',ramdisk_id='',reservation_id='r-c2yen7yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-762093980',owner_user_name='tempest-TaggedBootDevicesTest-762093980-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fda97057cf6440f8a117c8a01cde53a',uuid=4b822b32-bf4e-43e4-9024-32318a7db4ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converting VIF {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51a3c765-0f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:d3:ed,bridge_name='br-int',has_traffic_filtering=True,id=39c10a5f-6007-4268-a337-da0f1c17c553,network=Network(c5829f77-113b-4bfb-b286-e761e95a882b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c10a5f-60')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c39df9-0b, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:6c:b0,bridge_name='br-int',has_traffic_filtering=True,id=51a3c765-0fbe-472f-bf1d-a49f663bdeea,network=Network(4fbddf17-0174-4597-94a8-1fb272515673),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51a3c765-0f')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fklIOKSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:07 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:cc:7f,bridge_name='br-int',has_traffic_filtering=True,id=50c39df9-0b72-4b14-96ca-356d0dc32f1c,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c39df9-0b')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-956152073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-956152073',id=12,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg==',key_name='tempest-keypair-2087464564',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c144e1059e44b55bb7aa451b9547a75',ramdisk_id='',reservation_id='r-6n8307kv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1893104567',owner_user_name='tempest-TaggedBootDevicesTest_v242-1893104567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2f35f746a2c41828b209a93f555993c',uuid=fc8f8805-6d61-45a5-b56f-d2c0b107e9c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converting VIF {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d81600b-d6, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f5228-db44-458e-8051-c99bcb61826c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:07 user nova-compute[71063]: No targets found.
Apr 11 17:06:07 user nova-compute[71063]: iSNS:
Apr 11 17:06:07 user nova-compute[71063]: No targets found.
Apr 11 17:06:07 user nova-compute[71063]: STATIC:
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:07 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:07 user nova-compute[71063]: No targets found.
Apr 11 17:06:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:07 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:07 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:07 user nova-compute[71063]: INFO os_vif [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:0c:bc,bridge_name='br-int',has_traffic_filtering=True,id=9d81600b-d6e0-4715-9c00-f24f7a2d8fcb,network=Network(b0019c18-8ef1-4bfd-8bd9-832a0aa82609),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d81600b-d6')
Apr 11 17:06:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKcvVxyu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53de16-2c87-403e-b01e-99dc6c49be71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: INFO nova.compute.manager [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Attaching volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 to /dev/vdb
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f70c4c-a23a-400f-a65d-84c1a7754783]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8071b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf695bc-aaea-408d-aed9-754eba1aa390]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb9e1b2-02ec-4dc0-ad7f-9339cd1234b3]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4263092d-7ee5-48ea-b2cc-2aab8fbb8bb4]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.utils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc5883-64fa-4b01-8ea3-88b72301ef59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63977759-693d-4c10-a307-9719ed5fddf5]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c34d96-7ebe-4894-9525-58a7b021b314]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b004808e-73e0-4a63-847d-2984f1875dd0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea499b3d-f829-4d6f-b329-698a54668b88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77040f3-7f7f-4ef0-b9d3-06d5da4d4909]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e658ed-1a68-42df-9a8a-fa4257d81004]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260]
Apr 11 17:06:08 user nova-compute[71063]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37550c1-3a8d-4089-b6b6-d5bee0910607]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.utils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating existing volume attachment record: ed1020b1-0953-4f9d-b43a-6e86d8306bf2 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:498b42b1-60cf-4372-a5cf-6cdea4caded0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b76c1cf-47c9-4d18-bebb-0b04e0bd2278]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== disconnect_volume: return (414ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.373s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIkXgCql', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc97b5a-0915-4f4e-9664-5671ed881ea7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]: iSNS:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]: STATIC:
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:08 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:08 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c187559b-7969-42a5-b7ec-89f492743ca1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b9e26-bc08-4bc2-89f6-6ccc7274de44]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8071b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184'): ({'sde'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Removing single pathed devices sde {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274f42a-693c-4609-8683-c8ad6ee7db45]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b01e66-422b-4199-96ee-1b8efd31ef9b]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flushing IO for device /dev/sde {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a4fdc9-1ef7-427b-b783-5dec08027926]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-f73daf99-e281-41dc-87d9-f257045a8146 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-0affebd5-561c-497c-9491-338dce8905e9 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-0affebd5-561c-497c-9491-338dce8905e9 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af03822-3381-4697-a497-3da4e616ee1e]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c137f28c-b481-417b-bec5-d870641e25ba]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8839973b-3899-4b33-9cf8-a7a741ce19e2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260]
Apr 11 17:06:08 user nova-compute[71063]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7454087-e7d4-4c56-a159-187cdd2dc184 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541b19f-196c-4d0f-bc28-6676b64a10bc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== disconnect_volume: return (726ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.350s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UtvzhAsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d1ac3c-286c-446e-ab16-2af48ba4036e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]: iSNS:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]: STATIC:
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:08 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:08 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:08 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:08 user nova-compute[71063]: No targets found.
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:08 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:08 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9400ea76-5a45-48ab-a464-768adc8f5f81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2544a-5f68-49d8-9435-f58f9dc4162f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:08 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:08 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8071b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[97550fb4-08cb-4cf8-8440-d0629e3b1613]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3a31c6-2b67-4573-806c-2d8c272883cc]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[91405875-181f-43ad-9595-a1b0cd4e0f08]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-unplugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-unplugged-99ac8a24-e783-4834-a419-d58b3e288aa4 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquiring lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] No waiting events found dispatching network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received unexpected event network-vif-plugged-99ac8a24-e783-4834-a419-d58b3e288aa4 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing instance network info cache due to event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquiring lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquired lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.network.neutron [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae38391d-dc54-4536-918a-00dd0c784b8a]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-39c10a5f-6007-4268-a337-da0f1c17c553 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-39c10a5f-6007-4268-a337-da0f1c17c553 for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-unplugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-unplugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:08 user nova-compute[71063]: WARNING nova.compute.manager [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance with vm_state active and task_state deleting.
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628b3fb-95f4-4667-a574-6490a1d6c009]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa78165-fcd4-4a99-91f6-72f06cc9dc1a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260]
Apr 11 17:06:09 user nova-compute[71063]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a309ad9f-380c-4dda-83e1-7f5f0acf75b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d0d0ed-92d5-4e25-a706-64ab947c5c09]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== disconnect_volume: return (669ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.317s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDawqmRJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0130f77-446c-4894-9695-a435ea77fe45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: iSNS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: STATIC:
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:09 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f4ae1-3397-4ef9-89d8-1dfa41460ed6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee4370-58f6-4a12-993d-125546e6a36e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb429a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee'): ({'sdg'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Removing single pathed devices sdg {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547c57e-0e36-4507-9390-9ee0d4a5fa6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[69016e52-7b83-41e0-a0ff-1a5573c7c1c0]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flushing IO for device /dev/sdg {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afc42de-4cdf-4a91-b1ee-d9bcf64486a2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5346a0f-3f81-41ce-8f66-df66738b2028]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d198c-0f36-4c20-85e5-5ebda747bb96]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4e79ec-183d-41f9-9e8a-eec11dfa3a4d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260]
Apr 11 17:06:09 user nova-compute[71063]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b187ea12-9922-4398-a612-60259900feee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b80b6-f864-4602-ac3c-809541ba069f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== disconnect_volume: return (617ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.297s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXGrkOcP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bcc08f-a485-4578-b194-3d91a0b7fcb1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: iSNS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: STATIC:
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:09 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71db75c-4955-422b-add9-4ec40a107566]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65cb141-c84c-43d6-9745-6f4459aef8c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb42d2830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff5e508-976b-46f3-817b-5cd4ea0a2379]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99334bb-1fc5-4bcd-b099-be2dc394a1c6]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8bfad-25cd-455a-8f90-989c075deaa6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc14d423-482e-446d-b532-4714bea09531]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9879f35e-a725-4112-8c56-6adf06e897d2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[538bb3dd-1180-4c6b-8e05-2b005029e35c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260]
Apr 11 17:06:09 user nova-compute[71063]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d307a14d-98e3-406f-baef-24e6a61dc887 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da20aa0-4d92-4d0a-bfb3-56974dd26a51]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] <== disconnect_volume: return (605ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Deleting instance files /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee_del
Apr 11 17:06:09 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Deletion of /opt/stack/data/nova/instances/4b822b32-bf4e-43e4-9024-32318a7db4ee_del complete
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e90075-dd7c-4049-9cc6-b0f24c709946]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: iSNS:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]: STATIC:
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23
Apr 11 17:06:09 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:09 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:09 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:09 user nova-compute[71063]: No targets found.
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:09 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:09 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5052c-a420-4796-ba2f-576539a16ba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: INFO nova.compute.manager [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Took 5.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c951e3-a95a-48ff-9b70-da37b6128470]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 (non-flash)
Apr 11 17:06:09 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb429b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6874831f-a4d6-4891-b05d-8949f54ccf89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99137cf-92a1-4845-893b-969a558bd76b]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.network.neutron [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updated VIF entry in instance network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.network.neutron [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating instance_info_cache with network_info: [{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7965be8-7ba3-44bf-990e-03c437956d36]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Releasing lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[670cbf60-09de-4e8f-9b4c-9b72efb5df2e]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[88853e69-57a7-4b38-80d9-0ce0d9173b8a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08c1f9c-01be-4c0c-8f51-080ed136fe75]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260]
Apr 11 17:06:10 user nova-compute[71063]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:10 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3cc231-2504-4ee1-a0e8-daabd3795b23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbdee88-0e74-4403-86f1-0760dc5ee3c3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] <== disconnect_volume: return (674ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Deleting instance files /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1_del
Apr 11 17:06:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Deletion of /opt/stack/data/nova/instances/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1_del complete
Apr 11 17:06:10 user nova-compute[71063]: INFO nova.compute.manager [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Took 5.23 seconds to destroy the instance on the hypervisor.
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Acquiring lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] No waiting events found dispatching network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:10 user nova-compute[71063]: WARNING nova.compute.manager [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received unexpected event network-vif-plugged-50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance with vm_state active and task_state deleting.
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-deleted-8a27e645-0909-4786-a624-5d12630f2e1b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:11 user nova-compute[71063]: INFO nova.compute.manager [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Neutron deleted interface 8a27e645-0909-4786-a624-5d12630f2e1b; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "address": "fa:16:3e:ac:6c:b0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a3c765-0f", "ovs_interfaceid": "51a3c765-0fbe-472f-bf1d-a49f663bdeea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Detach interface failed, port_id=8a27e645-0909-4786-a624-5d12630f2e1b, reason: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:06:12 user nova-compute[71063]: INFO nova.compute.claims [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Claim successful on node user
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-deleted-39c10a5f-6007-4268-a337-da0f1c17c553 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:12 user nova-compute[71063]: INFO nova.compute.manager [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Neutron deleted interface 39c10a5f-6007-4268-a337-da0f1c17c553; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "address": "fa:16:3e:49:8a:31", "network": {"id": "15ad4720-343d-4440-b8ea-91b96b18416d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-269210998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdf099d-90", "ovs_interfaceid": "dfdf099d-908f-40d1-937c-cfa70a5b38b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Detach interface failed, port_id=39c10a5f-6007-4268-a337-da0f1c17c553, reason: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLgtlxhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:13 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1bcd40-b5cd-4708-a378-b0595f0b6e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:06:13 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fc44e-0c1b-4d13-888b-350d1f33b732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9] added
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bef912-fecb-4fe3-9622-6967d2cab37b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33301b-fc75-4249-8478-ba333cef088d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.virt.block_device [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Booting with blank volume at /dev/vda
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLgtlxhi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.policy [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dLgtlxhi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f21f04-8be0-4651-b19d-02635dc93527]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dLgtlxhi'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[37155f33-04cb-4ad4-843f-cab8bcaa48de]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b58cdf-169c-46e8-a994-f1a9a0586628]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc823796-ee6a-4605-b9b6-7ca98bca3a5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260]
Apr 11 17:06:13 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b828168-0844-451c-9ba7-8467bf29f9d5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[197729d5-6713-43ef-bd61-7b44e25edbea]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)
Apr 11 17:06:13 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)
Apr 11 17:06:13 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90700bfc-b8f3-45d5-b7ce-02ab44c8c6d8]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLgtlxhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-deleted-51a3c765-0fbe-472f-bf1d-a49f663bdeea {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Neutron deleted interface 51a3c765-0fbe-472f-bf1d-a49f663bdeea; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "address": "fa:16:3e:e5:5c:3c", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6dc07d2-c1", "ovs_interfaceid": "c6dc07d2-c1e5-44f7-8683-0162519e8613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Took 4.19 seconds to deallocate network for instance.
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Successfully created port: 67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Detach interface failed, port_id=51a3c765-0fbe-472f-bf1d-a49f663bdeea, reason: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-deleted-c6dc07d2-c1e5-44f7-8683-0162519e8613 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Neutron deleted interface c6dc07d2-c1e5-44f7-8683-0162519e8613; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "address": "fa:16:3e:30:db:d9", "network": {"id": "ec3dc14b-bb3d-476c-b632-ad7601808691", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1639172462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7320c7cb-cd", "ovs_interfaceid": "7320c7cb-cd67-4b96-bcd0-865515f9b472", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Detach interface failed, port_id=c6dc07d2-c1e5-44f7-8683-0162519e8613, reason: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-deleted-7320c7cb-cd67-4b96-bcd0-865515f9b472 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:13 user nova-compute[71063]: INFO nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Neutron deleted interface 7320c7cb-cd67-4b96-bcd0-865515f9b472; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:13 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "99ac8a24-e783-4834-a419-d58b3e288aa4", "address": "fa:16:3e:2e:28:a0", "network": {"id": "4fbddf17-0174-4597-94a8-1fb272515673", "bridge": "br-int", "label": "tempest-device-tagging-net2-1555604440", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99ac8a24-e7", "ovs_interfaceid": "99ac8a24-e783-4834-a419-d58b3e288aa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Detach interface failed, port_id=7320c7cb-cd67-4b96-bcd0-865515f9b472, reason: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.666s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== connect_volume: return (1669ms) {'type': 'block', 'scsi_wwn': '23134643866313231', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134643866313231', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-deleted-dfdf099d-908f-40d1-937c-cfa70a5b38b5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:14 user nova-compute[71063]: INFO nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Neutron deleted interface dfdf099d-908f-40d1-937c-cfa70a5b38b5; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.network.neutron [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "address": "fa:16:3e:54:1a:0e", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d3c99c-9a", "ovs_interfaceid": "84d3c99c-9ae0-4d15-8338-ece1d9a04125", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7712MB free_disk=26.55236053466797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.objects.instance [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Detach interface failed, port_id=dfdf099d-908f-40d1-937c-cfa70a5b38b5, reason: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-deleted-84d3c99c-9ae0-4d15-8338-ece1d9a04125 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:14 user nova-compute[71063]: INFO nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Neutron deleted interface 84d3c99c-9ae0-4d15-8338-ece1d9a04125; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.network.neutron [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [{"id": "f73daf99-e281-41dc-87d9-f257045a8146", "address": "fa:16:3e:e1:f5:35", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf73daf99-e2", "ovs_interfaceid": "f73daf99-e281-41dc-87d9-f257045a8146", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0affebd5-561c-497c-9491-338dce8905e9", "address": "fa:16:3e:ee:5c:5d", "network": {"id": "c5829f77-113b-4bfb-b286-e761e95a882b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1097629959", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0affebd5-56", "ovs_interfaceid": "0affebd5-561c-497c-9491-338dce8905e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "address": "fa:16:3e:f9:cc:7f", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c39df9-0b", "ovs_interfaceid": "50c39df9-0b72-4b14-96ca-356d0dc32f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "address": "fa:16:3e:12:0c:bc", "network": {"id": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "bridge": "br-int", "label": "tempest-device-tagging-net2-2114274815", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "6c144e1059e44b55bb7aa451b9547a75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d81600b-d6", "ovs_interfaceid": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:06:14 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:14 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:06:14 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:06:14 user nova-compute[71063]:   <serial>5034b953-1e89-44c6-bdba-7c70ef8124a9</serial>
Apr 11 17:06:14 user nova-compute[71063]: </disk>
Apr 11 17:06:14 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Detach interface failed, port_id=84d3c99c-9ae0-4d15-8338-ece1d9a04125, reason: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Successfully updated port: 67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-changed-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Refreshing instance network info cache due to event network-changed-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:15 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Took 5.01 seconds to deallocate network for instance.
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No VIF found with MAC fa:16:3e:b3:d9:49, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.259s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance network_info: |[{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.network.neutron [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Refreshing network info cache for port 67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Received event network-vif-deleted-99ac8a24-e783-4834-a419-d58b3e288aa4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:15 user nova-compute[71063]: INFO nova.compute.manager [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Neutron deleted interface 99ac8a24-e783-4834-a419-d58b3e288aa4; detaching it from the instance and deleting it from the info cache
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.network.neutron [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Updating instance_info_cache with network_info: [{"id": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "address": "fa:16:3e:8c:4c:a5", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4c6824f-e5", "ovs_interfaceid": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "address": "fa:16:3e:33:c9:3e", "network": {"id": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "bridge": "br-int", "label": "tempest-device-tagging-net1-458590217", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d5ab1632b5534eb9b5096d25137bd538", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap818fbdc6-1f", "ovs_interfaceid": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Detach interface failed, port_id=99ac8a24-e783-4834-a419-d58b3e288aa4, reason: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updated VIF entry in instance network info cache for port 67d00c4b-a9a1-4ac1-8df9-e7fd43a17056. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-deleted-9d81600b-d6e0-4715-9c00-f24f7a2d8fcb {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Received event network-vif-deleted-50c39df9-0b72-4b14-96ca-356d0dc32f1c {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:16 user nova-compute[71063]: INFO nova.compute.manager [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Took 2.74 seconds to detach 3 volumes for instance.
Apr 11 17:06:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:16 user nova-compute[71063]: INFO nova.compute.manager [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Detaching volume 5034b953-1e89-44c6-bdba-7c70ef8124a9
Apr 11 17:06:17 user nova-compute[71063]: INFO nova.virt.block_device [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Attempting to driver detach volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 from mountpoint /dev/vdb
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Attempting to detach device vdb from instance 9339e177-6264-4942-9dd1-372681209790 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:06:17 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:17 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:06:17 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:06:17 user nova-compute[71063]:   <serial>5034b953-1e89-44c6-bdba-7c70ef8124a9</serial>
Apr 11 17:06:17 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:06:17 user nova-compute[71063]: </disk>
Apr 11 17:06:17 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:06:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully detached device vdb from instance 9339e177-6264-4942-9dd1-372681209790 from the persistent domain config.
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9339e177-6264-4942-9dd1-372681209790 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:06:17 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:17 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:06:17 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:06:17 user nova-compute[71063]:   <serial>5034b953-1e89-44c6-bdba-7c70ef8124a9</serial>
Apr 11 17:06:17 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:06:17 user nova-compute[71063]: </disk>
Apr 11 17:06:17 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:17 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Deleted allocations for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "4b822b32-bf4e-43e4-9024-32318a7db4ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.394s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232777.4303882, 9339e177-6264-4942-9dd1-372681209790 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:06:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully detached device vdb from instance 9339e177-6264-4942-9dd1-372681209790 from the live domain config.
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dLgtlxhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:17 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d40913-de90-40e3-b0f8-1cc5276c3e70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:06:17 user nova-compute[71063]: No targets found.
Apr 11 17:06:17 user nova-compute[71063]: iSNS:
Apr 11 17:06:17 user nova-compute[71063]: No targets found.
Apr 11 17:06:17 user nova-compute[71063]: STATIC:
Apr 11 17:06:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:06:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9
Apr 11 17:06:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:06:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:06:17 user nova-compute[71063]: FIRMWARE:
Apr 11 17:06:17 user nova-compute[71063]: No targets found.
Apr 11 17:06:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:06:17 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:06:17 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5683d0a7-52da-4304-a1a2-1f41917051a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e98453-bb17-486f-9ecd-964cc2594cd0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)
Apr 11 17:06:17 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 (non-flash)
Apr 11 17:06:17 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8063b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[01242602-54e0-452f-a8a6-d02e0dd2c35a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c85a7ae-7414-4bb9-bf7a-96b11f3fbdc1]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e9c98e-3aaf-4bff-a81b-ad9201d10fd1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ead2fd-33fe-472f-bc65-86b5f6688199]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0870f-bb2a-4f0d-bd7d-c6215d7fd1cb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34fe125-515c-4339-b51b-175a829c6cf3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260]
Apr 11 17:06:17 user nova-compute[71063]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5034b953-1e89-44c6-bdba-7c70ef8124a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[84093592-7fbb-4b82-a114-3ef3761e8fcf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== disconnect_volume: return (299ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:06:17 user nova-compute[71063]: INFO nova.compute.manager [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Took 2.86 seconds to detach 3 volumes for instance.
Apr 11 17:06:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:18 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Deleted allocations for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.666s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.utils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[58276a55-e428-4f06-8668-675cdb307570]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8d457f-b85f-4c72-9072-0ef762b771b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e295160-668f-4645-afb6-11ed117b9701]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef37b65-7913-4e15-a2a4-c2b01c660d22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:18 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:06:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94615b-05a9-4401-9c0c-8c0c79e25e30]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG os_brick.utils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:18 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating existing volume attachment record: 587ae320-df30-40f2-8887-d2490c7da071 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:06:21 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232766.3054566, 4b822b32-bf4e-43e4-9024-32318a7db4ee => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:21 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] VM Stopped (Lifecycle Event)
Apr 11 17:06:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cc5d9693-f778-4afd-8878-e164bc7d6d39 None None] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:21 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232766.7123888, fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:21 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] VM Stopped (Lifecycle Event)
Apr 11 17:06:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8f880195-1d27-4f8b-8253-7e75bd422e8a None None] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:06:23 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Creating image(s)
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Ensure instance console log exists: /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start _get_guest_xml network_info=[{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '587ae320-df30-40f2-8887-d2490c7da071', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1289fdf8-8842-4e16-80dc-a287bc08fb02', 'attached_at': '', 'detached_at': '', 'volume_id': 'c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'serial': 'c91d72cc-4a7c-493c-992e-ac58f20b3c70'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:06:23 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:23 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:23 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:23 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:23 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae61eca0-a043-4bb5-833a-739dc74cec52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:06:23 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e884282-e888-418c-b05f-b4a89c101cba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70] added
Apr 11 17:06:23 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[81260290-9918-4891-bd1a-6b6e987d5815]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[646a0901-df04-4a52-82f3-718481c27190]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIPDxtjT {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIPDxtjT" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a233c-0dba-4194-b7ea-985b6d95b14e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIPDxtjT'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee167ed-af15-455b-98d0-a53c18795966]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b39be5-e7de-46c8-892f-50a4a3d25f20]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:23 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:23 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e3aac-c2e7-4615-ba57-f119dad902e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260]
Apr 11 17:06:24 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260] successful.
Apr 11 17:06:24 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[af25263a-5766-4646-b66e-f946cb6579d7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3844d26-c4ba-4fdc-8851-0a0d879db509]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:06:24 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:24 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:06:24 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:06:24 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e1add-9d8b-45d1-8983-05cfab7e052a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:06:24 user nova-compute[71063]: INFO nova.compute.claims [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Claim successful on node user
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:06:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:06:24 user nova-compute[71063]: DEBUG nova.policy [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:06:25 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Creating image(s)
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "/opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "/opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "/opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23338613435313265', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613435313265', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291128519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291128519',id=14,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-7w7db0fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:06:13Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=1289fdf8-8842-4e16-80dc-a287bc08fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.objects.instance [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:06:25 user nova-compute[71063]:   <uuid>1289fdf8-8842-4e16-80dc-a287bc08fb02</uuid>
Apr 11 17:06:25 user nova-compute[71063]:   <name>instance-0000000e</name>
Apr 11 17:06:25 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:06:25 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:06:25 user nova-compute[71063]:   <metadata>
Apr 11 17:06:25 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:06:25 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1291128519</nova:name>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:06:23</nova:creationTime>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:06:25 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:06:25 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:owner>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:06:25 user nova-compute[71063]:       </nova:owner>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:06:25 user nova-compute[71063]:       <nova:ports>
Apr 11 17:06:25 user nova-compute[71063]:         <nova:port uuid="67d00c4b-a9a1-4ac1-8df9-e7fd43a17056">
Apr 11 17:06:25 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:06:25 user nova-compute[71063]:         </nova:port>
Apr 11 17:06:25 user nova-compute[71063]:       </nova:ports>
Apr 11 17:06:25 user nova-compute[71063]:     </nova:instance>
Apr 11 17:06:25 user nova-compute[71063]:   </metadata>
Apr 11 17:06:25 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:06:25 user nova-compute[71063]:     <system>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="serial">1289fdf8-8842-4e16-80dc-a287bc08fb02</entry>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="uuid">1289fdf8-8842-4e16-80dc-a287bc08fb02</entry>
Apr 11 17:06:25 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:06:25 user nova-compute[71063]:     </system>
Apr 11 17:06:25 user nova-compute[71063]:   </sysinfo>
Apr 11 17:06:25 user nova-compute[71063]:   <os>
Apr 11 17:06:25 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:06:25 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:06:25 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:06:25 user nova-compute[71063]:   </os>
Apr 11 17:06:25 user nova-compute[71063]:   <features>
Apr 11 17:06:25 user nova-compute[71063]:     <acpi/>
Apr 11 17:06:25 user nova-compute[71063]:     <apic/>
Apr 11 17:06:25 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:06:25 user nova-compute[71063]:   </features>
Apr 11 17:06:25 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:06:25 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:06:25 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:06:25 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:06:25 user nova-compute[71063]:   </clock>
Apr 11 17:06:25 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:06:25 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:06:25 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:06:25 user nova-compute[71063]:   </cpu>
Apr 11 17:06:25 user nova-compute[71063]:   <devices>
Apr 11 17:06:25 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:06:25 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:06:25 user nova-compute[71063]:       <source dev="/dev/sdb"/>
Apr 11 17:06:25 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:06:25 user nova-compute[71063]:       <serial>c91d72cc-4a7c-493c-992e-ac58f20b3c70</serial>
Apr 11 17:06:25 user nova-compute[71063]:     </disk>
Apr 11 17:06:25 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:06:25 user nova-compute[71063]:       <mac address="fa:16:3e:d4:9b:bc"/>
Apr 11 17:06:25 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:06:25 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:06:25 user nova-compute[71063]:       <target dev="tap67d00c4b-a9"/>
Apr 11 17:06:25 user nova-compute[71063]:     </interface>
Apr 11 17:06:25 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:06:25 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/console.log" append="off"/>
Apr 11 17:06:25 user nova-compute[71063]:     </serial>
Apr 11 17:06:25 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:06:25 user nova-compute[71063]:     <video>
Apr 11 17:06:25 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:06:25 user nova-compute[71063]:     </video>
Apr 11 17:06:25 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:06:25 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:06:25 user nova-compute[71063]:     </rng>
Apr 11 17:06:25 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:06:25 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:06:25 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:06:25 user nova-compute[71063]:     </memballoon>
Apr 11 17:06:25 user nova-compute[71063]:   </devices>
Apr 11 17:06:25 user nova-compute[71063]: </domain>
Apr 11 17:06:25 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291128519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291128519',id=14,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-7w7db0fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:06:13Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=1289fdf8-8842-4e16-80dc-a287bc08fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG os_vif [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d00c4b-a9, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67d00c4b-a9, col_values=(('external_ids', {'iface-id': '67d00c4b-a9a1-4ac1-8df9-e7fd43a17056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:9b:bc', 'vm-uuid': '1289fdf8-8842-4e16-80dc-a287bc08fb02'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:25 user nova-compute[71063]: INFO os_vif [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9')
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:d4:9b:bc, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk 1073741824" returned: 0 in 0.045s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Successfully created port: 84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Cannot resize image /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.objects.instance [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'migration_context' on Instance uuid d136c0bb-535b-4d89-ba3a-a1306e0c8f1b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Ensure instance console log exists: /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Successfully updated port: 84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-changed-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Refreshing instance network info cache due to event network-changed-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Acquiring lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Acquired lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Refreshing network info cache for port 84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:27 user nova-compute[71063]: WARNING nova.compute.manager [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state building and task_state spawning.
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Releasing lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquired lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Updating instance_info_cache with network_info: [{"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Releasing lock "refresh_cache-d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance network_info: |[{"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Start _get_guest_xml network_info=[{"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:06:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1508615167',display_name='tempest-VolumesAdminNegativeTest-server-1508615167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1508615167',id=15,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-bklesfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:06:25Z,user_data=None,user_id='d111d892e2944f279a36622978b2dd06',uuid=d136c0bb-535b-4d89-ba3a-a1306e0c8f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.objects.instance [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'pci_devices' on Instance uuid d136c0bb-535b-4d89-ba3a-a1306e0c8f1b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:06:27 user nova-compute[71063]:   <uuid>d136c0bb-535b-4d89-ba3a-a1306e0c8f1b</uuid>
Apr 11 17:06:27 user nova-compute[71063]:   <name>instance-0000000f</name>
Apr 11 17:06:27 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:06:27 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:06:27 user nova-compute[71063]:   <metadata>
Apr 11 17:06:27 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:06:27 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1508615167</nova:name>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:06:27</nova:creationTime>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:06:27 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:06:27 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:owner>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:user uuid="d111d892e2944f279a36622978b2dd06">tempest-VolumesAdminNegativeTest-1639987679-project-member</nova:user>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:project uuid="381738c7ad99437b875807c4252965bf">tempest-VolumesAdminNegativeTest-1639987679</nova:project>
Apr 11 17:06:27 user nova-compute[71063]:       </nova:owner>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:06:27 user nova-compute[71063]:       <nova:ports>
Apr 11 17:06:27 user nova-compute[71063]:         <nova:port uuid="84508dcf-4b2a-4a8c-807f-12f73bf1fa0f">
Apr 11 17:06:27 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 17:06:27 user nova-compute[71063]:         </nova:port>
Apr 11 17:06:27 user nova-compute[71063]:       </nova:ports>
Apr 11 17:06:27 user nova-compute[71063]:     </nova:instance>
Apr 11 17:06:27 user nova-compute[71063]:   </metadata>
Apr 11 17:06:27 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:06:27 user nova-compute[71063]:     <system>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="serial">d136c0bb-535b-4d89-ba3a-a1306e0c8f1b</entry>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="uuid">d136c0bb-535b-4d89-ba3a-a1306e0c8f1b</entry>
Apr 11 17:06:27 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:06:27 user nova-compute[71063]:     </system>
Apr 11 17:06:27 user nova-compute[71063]:   </sysinfo>
Apr 11 17:06:27 user nova-compute[71063]:   <os>
Apr 11 17:06:27 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:06:27 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:06:27 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:06:27 user nova-compute[71063]:   </os>
Apr 11 17:06:27 user nova-compute[71063]:   <features>
Apr 11 17:06:27 user nova-compute[71063]:     <acpi/>
Apr 11 17:06:27 user nova-compute[71063]:     <apic/>
Apr 11 17:06:27 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:06:27 user nova-compute[71063]:   </features>
Apr 11 17:06:27 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:06:27 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:06:27 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:06:27 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:06:27 user nova-compute[71063]:   </clock>
Apr 11 17:06:27 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:06:27 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:06:27 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:06:27 user nova-compute[71063]:   </cpu>
Apr 11 17:06:27 user nova-compute[71063]:   <devices>
Apr 11 17:06:27 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:06:27 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:06:27 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk"/>
Apr 11 17:06:27 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:06:27 user nova-compute[71063]:     </disk>
Apr 11 17:06:27 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:06:27 user nova-compute[71063]:       <mac address="fa:16:3e:4f:cf:e2"/>
Apr 11 17:06:27 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:06:27 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:06:27 user nova-compute[71063]:       <target dev="tap84508dcf-4b"/>
Apr 11 17:06:27 user nova-compute[71063]:     </interface>
Apr 11 17:06:27 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:06:27 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/console.log" append="off"/>
Apr 11 17:06:27 user nova-compute[71063]:     </serial>
Apr 11 17:06:27 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:06:27 user nova-compute[71063]:     <video>
Apr 11 17:06:27 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:06:27 user nova-compute[71063]:     </video>
Apr 11 17:06:27 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:06:27 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:06:27 user nova-compute[71063]:     </rng>
Apr 11 17:06:27 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:06:27 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:06:27 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:06:27 user nova-compute[71063]:     </memballoon>
Apr 11 17:06:27 user nova-compute[71063]:   </devices>
Apr 11 17:06:27 user nova-compute[71063]: </domain>
Apr 11 17:06:27 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1508615167',display_name='tempest-VolumesAdminNegativeTest-server-1508615167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1508615167',id=15,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-bklesfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:06:25Z,user_data=None,user_id='d111d892e2944f279a36622978b2dd06',uuid=d136c0bb-535b-4d89-ba3a-a1306e0c8f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG os_vif [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84508dcf-4b, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84508dcf-4b, col_values=(('external_ids', {'iface-id': '84508dcf-4b2a-4a8c-807f-12f73bf1fa0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:cf:e2', 'vm-uuid': 'd136c0bb-535b-4d89-ba3a-a1306e0c8f1b'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:27 user nova-compute[71063]: INFO os_vif [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b')
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:06:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] No VIF found with MAC fa:16:3e:4f:cf:e2, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232788.8261576, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Resumed (Lifecycle Event)
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:06:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance spawned successfully.
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232788.826327, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Started (Lifecycle Event)
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:06:29 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:06:29 user nova-compute[71063]: INFO nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 11 17:06:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:29 user nova-compute[71063]: WARNING nova.compute.manager [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state building and task_state spawning.
Apr 11 17:06:29 user nova-compute[71063]: INFO nova.compute.manager [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Took 16.90 seconds to build instance.
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.011s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] No waiting events found dispatching network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:29 user nova-compute[71063]: WARNING nova.compute.manager [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received unexpected event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance with vm_state building and task_state spawning.
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232791.1342554, d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] VM Resumed (Lifecycle Event)
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance spawned successfully.
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232791.1385436, d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] VM Started (Lifecycle Event)
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Took 6.23 seconds to spawn the instance on the hypervisor.
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] No waiting events found dispatching network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:31 user nova-compute[71063]: WARNING nova.compute.manager [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received unexpected event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance with vm_state active and task_state None.
Apr 11 17:06:31 user nova-compute[71063]: INFO nova.compute.manager [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Took 7.13 seconds to build instance.
Apr 11 17:06:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'flavor' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:54 user nova-compute[71063]: INFO nova.compute.manager [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attaching volume 924a836a-8dba-4bec-aa59-5cc6250874bc to /dev/vdb
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.utils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[010dc0fb-3705-4786-ab71-fbae29f73264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b934607-0f6a-4a94-82e8-0aa958e9609a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[307440ab-d0f4-455c-a560-7772eeae768b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64794c3-6217-4f12-8f0e-111a48583587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:55 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75138d9-ccef-4864-a350-980b83518be0]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG os_brick.utils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating existing volume attachment record: 23fc25d2-0f0e-4331-a8c6-4538537b9e1a {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:55 user nova-compute[71063]: INFO nova.compute.manager [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Terminating instance
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-unplugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] No waiting events found dispatching network-vif-unplugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-unplugged-3bc601e8-552e-473e-abe3-24e32a78188f for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'flavor' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Instance destroyed successfully.
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'resources' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1632556398',display_name='tempest-TestVolumeSwap-server-1632556398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1632556398',id=10,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwQqBR25F/d8+YQpxEvpMHcmc9ai8/bmMyB08gTAOS/9e0+ptL1kApIgEHLD2wpbxwJv/e1PvASxFkuguZZmHUsixgqr0BQkG9MSSBFMuViP9XL3XIwb0RQ4dQ2b71JAw==',key_name='tempest-keypair-527051490',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9791f1371ba74005a40cd51a63d63c94',ramdisk_id='',reservation_id='r-cctxzye8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1972836137',owner_user_name='tempest-TestVolumeSwap-1972836137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f20dcfb0f94c419b9111571e89bc3aa4',uuid=180c44cc-172d-4e8c-b4ec-6259e775c404,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converting VIF {"id": "3bc601e8-552e-473e-abe3-24e32a78188f", "address": "fa:16:3e:90:90:b4", "network": {"id": "3f167744-bc75-4e0f-8b4e-c56a4899c588", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2001367628-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9791f1371ba74005a40cd51a63d63c94", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bc601e8-55", "ovs_interfaceid": "3bc601e8-552e-473e-abe3-24e32a78188f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_vif [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bc601e8-55, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:56 user nova-compute[71063]: INFO os_vif [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:90:b4,bridge_name='br-int',has_traffic_filtering=True,id=3bc601e8-552e-473e-abe3-24e32a78188f,network=Network(3f167744-bc75-4e0f-8b4e-c56a4899c588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bc601e8-55')
Apr 11 17:06:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Deleting instance files /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404_del
Apr 11 17:06:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Deletion of /opt/stack/data/nova/instances/180c44cc-172d-4e8c-b4ec-6259e775c404_del complete
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:56 user nova-compute[71063]: INFO nova.compute.manager [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attaching volume 24daff67-0055-44fd-8be9-acf4b3f77ff5 to /dev/vdb
Apr 11 17:06:56 user nova-compute[71063]: INFO nova.compute.manager [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.utils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f241009-c5ae-4044-bfd2-49434f06a5fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[399e1bfd-aaf7-497a-9df0-aa7ea8562eb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a636a809-5956-47fb-9c26-f595d189067e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae588d6a-b716-4c76-bbc0-b84bf51af829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:06:56 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:06:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90c9c5-5cf3-4204-ab06-4579383b9e6c]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG os_brick.utils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:06:56 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating existing volume attachment record: 0a4714ac-7476-49f1-906b-a5de8113bbd6 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:06:57 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Took 0.86 seconds to deallocate network for instance.
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:57 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Deleted allocations for instance 180c44cc-172d-4e8c-b4ec-6259e775c404
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Acquiring lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] No waiting events found dispatching network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:06:57 user nova-compute[71063]: WARNING nova.compute.manager [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received unexpected event network-vif-plugged-3bc601e8-552e-473e-abe3-24e32a78188f for instance with vm_state deleted and task_state None.
Apr 11 17:06:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Received event network-vif-deleted-3bc601e8-552e-473e-abe3-24e32a78188f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:06:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "180c44cc-172d-4e8c-b4ec-6259e775c404" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:06:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:06:59 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:59 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:06:59 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f008782-c738-49ea-a7c6-6487bebb80ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:06:59 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85030a9-9235-46af-92b8-f3cf28ac73ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc] added
Apr 11 17:06:59 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4988951-cde8-4459-810a-fd7698a5ad8c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb88bc-3c02-4c66-9ac6-cdfb0b40f4c2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:06:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZbsYOGj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZbsYOGj" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f6b33f-3d92-472e-b9e8-4bdd2ddf4e5e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZbsYOGj'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce8c40-c274-4000-813b-4a483b0af5ba]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[222fb89f-d29e-4b2a-9ac0-8ead126b5ee5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:00 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:00 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744f866-9793-433e-8652-f94e98b784ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260]
Apr 11 17:07:00 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:00 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccf8a3f-2a7f-424b-9b48-29773db49859]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a4fc1a-0eae-49e9-941b-29f917e557aa]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:00 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:00 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:00 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a58cc-197d-45ff-875c-2593b08c303c]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:00 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23639626635636539', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639626635636539', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'flavor' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:07:01 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:01 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:07:01 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:07:01 user nova-compute[71063]:   <serial>924a836a-8dba-4bec-aa59-5cc6250874bc</serial>
Apr 11 17:07:01 user nova-compute[71063]: </disk>
Apr 11 17:07:01 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:01 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:01 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:01 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaed960-27b7-4d64-820e-44a10d219757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:07:01 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.082s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a998a40-43c7-4614-b6ed-178326c7dd29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5] added
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b86720b-847c-4ab6-8478-27eef6217a32]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dacf93-8f90-41c9-a5ab-8d625868e9bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRKyqiNw {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRKyqiNw" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf549c4b-bc13-4071-aad8-c4c2b5d31c1c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fRKyqiNw'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63238d8-2a92-47cd-8816-89990c4fee5f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No VIF found with MAC fa:16:3e:70:63:7b, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6813a180-c84a-466b-b467-40c886511ef8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b1702-f881-47a7-af7f-b0d689fc8ef6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]
Apr 11 17:07:01 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40f4fa-3767-46a4-bad2-3d3a420040a3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2469ee9-4955-481a-a2d2-fcd873841f92]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:01 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[87170959-2414-4491-83d9-b2efcd68ff29]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.063s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:02 user nova-compute[71063]: INFO nova.compute.manager [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Rescuing
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:02 user nova-compute[71063]: DEBUG nova.network.neutron [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23132356565393833', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132356565393833', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.objects.instance [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'flavor' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:07:03 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:03 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:07:03 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:07:03 user nova-compute[71063]:   <serial>24daff67-0055-44fd-8be9-acf4b3f77ff5</serial>
Apr 11 17:07:03 user nova-compute[71063]: </disk>
Apr 11 17:07:03 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:6d:79:2f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.500s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:04 user nova-compute[71063]: WARNING nova.compute.manager [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state rescuing.
Apr 11 17:07:04 user nova-compute[71063]: INFO nova.compute.manager [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Rebuilding instance
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance destroyed successfully.
Apr 11 17:07:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attempting a stable device rescue
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_requests' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:07:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Creating image(s)
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'migration_context' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:05 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71063) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 17:07:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance destroyed successfully.
Apr 11 17:07:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.part --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.images [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 092f4818-05d2-4f43-becf-b000e59860ae was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.part /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: INFO nova.compute.manager [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Detaching volume 24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:07:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.part /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.converted" returned: 0 in 0.200s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: INFO nova.virt.block_device [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attempting to driver detach volume 24daff67-0055-44fd-8be9-acf4b3f77ff5 from mountpoint /dev/vdb
Apr 11 17:07:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Attempting to detach device vdb from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:07:06 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:06 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:07:06 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:07:06 user nova-compute[71063]:   <serial>24daff67-0055-44fd-8be9-acf4b3f77ff5</serial>
Apr 11 17:07:06 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:07:06 user nova-compute[71063]: </disk>
Apr 11 17:07:06 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:07:06 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully detached device vdb from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the persistent domain config.
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7781da-56c8-4512-a2ac-59ec2a11ffd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:07:06 user nova-compute[71063]: No targets found.
Apr 11 17:07:06 user nova-compute[71063]: iSNS:
Apr 11 17:07:06 user nova-compute[71063]: No targets found.
Apr 11 17:07:06 user nova-compute[71063]: STATIC:
Apr 11 17:07:06 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:07:06 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:06 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:06 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:07:06 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:06 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:06 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:07:06 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:06 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:06 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:07:06 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:06 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:06 user nova-compute[71063]: FIRMWARE:
Apr 11 17:07:06 user nova-compute[71063]: No targets found.
Apr 11 17:07:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:07:06 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:07:06 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc89166-6956-41f3-9f7a-7e4605a969eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba00fe9-0527-4b59-a4c8-9f10b4763fd3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:06 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8063b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.452s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c77dc-ba2f-4c6e-b645-fad277f5d0c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state rescuing.
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state rebuilding.
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING nova.compute.manager [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state rebuilding.
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd496376-d3f0-4324-b7d5-24b8db35f22e]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4679047-ddc1-4134-a0c4-48a4149ced8b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[381332dd-90d0-473e-8938-883836aa0fe5]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d --force-share --output=json" returned: 0 in 0.174s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d,backing_fmt=raw /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f631fe1a-6aa3-4b54-9f58-ed26f0d12d77]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/672ee588178b3ad960e15f198a9b64b11e3a1c8d,backing_fmt=raw /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue" returned: 0 in 0.053s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "672ee588178b3ad960e15f198a9b64b11e3a1c8d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'migration_context' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start _get_guest_xml network_info=[{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "vif_mac": "fa:16:3e:70:63:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '092f4818-05d2-4f43-becf-b000e59860ae', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '23fc25d2-0f0e-4331-a8c6-4538537b9e1a', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '17f03f63-a491-4fd4-a282-a4e9b5b6aa2e', 'attached_at': '', 'detached_at': '', 'volume_id': '924a836a-8dba-4bec-aa59-5cc6250874bc', 'serial': '924a836a-8dba-4bec-aa59-5cc6250874bc'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'resources' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'numa_topology' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb30cf7-c67a-49a0-b4a8-30f44319a50c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]
Apr 11 17:07:06 user nova-compute[71063]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:06 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5876674f-f20f-46b4-8ed2-bc5d1084cfdc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (483ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:06 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:06 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[521d9459-9076-4286-ad78-168a47d82e08]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CZbsYOGj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 17:07:06 user nova-compute[71063]: node.name = iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:07:06 user nova-compute[71063]: node.tpgt = -1
Apr 11 17:07:06 user nova-compute[71063]: node.startup = automatic
Apr 11 17:07:06 user nova-compute[71063]: node.leading_login = No
Apr 11 17:07:06 user nova-compute[71063]: iface.iscsi_ifacename = default
Apr 11 17:07:06 user nova-compute[71063]: iface.net_ifacename = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.ipaddress = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.prefix_len = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.hwaddress = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.transport_name = tcp
Apr 11 17:07:06 user nova-compute[71063]: iface.initiatorname = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.vlan_id = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.vlan_priority = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.vlan_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.iface_num = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.mtu = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.port = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.bootproto = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.subnet_mask = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.gateway = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_alt_client_id = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_dns = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_learn_iqn = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_vendor_id_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_vendor_id = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.dhcp_slp_da = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.fragmentation = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.gratuitous_arp = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.incoming_forwarding = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.tos_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.tos = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.ttl = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.delayed_ack = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.tcp_nagle = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.tcp_wsf_state = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.tcp_wsf = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.tcp_timer_scale = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.tcp_timestamp = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.redirect = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.def_task_mgmt_timeout = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.header_digest = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.data_digest = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.immediate_data = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.initial_r2t = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.data_seq_inorder = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.data_pdu_inorder = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.erl = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.max_receive_data_len = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.first_burst_len = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.max_outstanding_r2t = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.max_burst_len = 0
Apr 11 17:07:06 user nova-compute[71063]: iface.chap_auth = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.bidi_chap = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.strict_login_compliance = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.discovery_auth = <empty>
Apr 11 17:07:06 user nova-compute[71063]: iface.discovery_logout = <empty>
Apr 11 17:07:06 user nova-compute[71063]: node.discovery_address = <empty>
Apr 11 17:07:06 user nova-compute[71063]: node.discovery_port = 0
Apr 11 17:07:06 user nova-compute[71063]: node.discovery_type = static
Apr 11 17:07:06 user nova-compute[71063]: node.session.initial_cmdsn = 0
Apr 11 17:07:06 user nova-compute[71063]: node.session.initial_login_retry_max = 8
Apr 11 17:07:06 user nova-compute[71063]: node.session.xmit_thread_priority = -20
Apr 11 17:07:06 user nova-compute[71063]: node.session.cmds_max = 128
Apr 11 17:07:06 user nova-compute[71063]: node.session.queue_depth = 32
Apr 11 17:07:06 user nova-compute[71063]: node.session.nr_sessions = 1
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.authmethod = CHAP
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.username = CZbsYOGj
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.password = ***
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.username_in = <empty>
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.password_in = <empty>
Apr 11 17:07:06 user nova-compute[71063]: node.session.auth.chap_algs = MD5
Apr 11 17:07:06 user nova-compute[71063]: node.session.timeo.replacement_timeout = 120
Apr 11 17:07:06 user nova-compute[71063]: node.session.err_timeo.abort_timeout = 15
Apr 11 17:07:06 user nova-compute[71063]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 17:07:06 user nova-compute[71063]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 17:07:06 user nova-compute[71063]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.FastAbort = Yes
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.InitialR2T = No
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.ImmediateData = Yes
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.MaxConnections = 1
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 17:07:06 user nova-compute[71063]: node.session.iscsi.ERL = 0
Apr 11 17:07:06 user nova-compute[71063]: node.session.scan = manual
Apr 11 17:07:06 user nova-compute[71063]: node.session.reopen_max = 0
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].address = 172.16.0.220
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].port = 3260
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].startup = manual
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].tcp.window_size = 524288
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].tcp.type_of_service = 0
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].timeo.logout_timeout = 15
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].timeo.login_timeout = 15
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].timeo.auth_timeout = 45
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.DataDigest = None
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.IFMarker = No
Apr 11 17:07:06 user nova-compute[71063]: node.conn[0].iscsi.OFMarker = No
Apr 11 17:07:06 user nova-compute[71063]: # END RECORD
Apr 11 17:07:06 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4bff3-5cd1-42b8-85ea-44f9b889d920]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3816d6f6-2b0a-4cbc-9f9e-fd7b1e1b4583]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZbsYOGj {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZbsYOGj" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85fc9c-e860-479e-b1d6-cc901af9ca42]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZbsYOGj'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d434621c-9e31-4ae2-b7d2-073ca49df2f8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[527c3c2b-c7e5-46fd-9bcc-f010d6d45c1b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b68e4-ed3b-4fed-ab13-b476ad62dec9]: (4, ('0 0 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.191s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23639626635636539', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639626635636539', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-296076626',display_name='tempest-ServerStableDeviceRescueTest-server-296076626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-296076626',id=2,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL7i/fp+DnNA0UzB89OuJAWEkDI3RLIMqdCUH+lLMjesQHNn0HLcj03mslu5ZdYDA0lbw8n78DIaEgXcMzFJM3/kIURu2fRqfoahFiI9aLfMiPTgBrcusJmx/nC+OKLjg==',key_name='tempest-keypair-1584212675',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b803e7cf929440298b14cd3177c96e8',ramdisk_id='',reservation_id='r-15wgi8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1699560884',owner_user_name='tempest-ServerStableDeviceRescueTest-1699560884-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6126b468bd2414d831b105a3429ddd1',uuid=17f03f63-a491-4fd4-a282-a4e9b5b6aa2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "vif_mac": "fa:16:3e:70:63:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converting VIF {"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "vif_mac": "fa:16:3e:70:63:7b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'pci_devices' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:07 user nova-compute[71063]:   <uuid>17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</uuid>
Apr 11 17:07:07 user nova-compute[71063]:   <name>instance-00000002</name>
Apr 11 17:07:07 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:07 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:07 user nova-compute[71063]:   <metadata>
Apr 11 17:07:07 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:07 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-296076626</nova:name>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:06</nova:creationTime>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:07 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:07 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:user uuid="c6126b468bd2414d831b105a3429ddd1">tempest-ServerStableDeviceRescueTest-1699560884-project-member</nova:user>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:project uuid="9b803e7cf929440298b14cd3177c96e8">tempest-ServerStableDeviceRescueTest-1699560884</nova:project>
Apr 11 17:07:07 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:07 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:07 user nova-compute[71063]:         <nova:port uuid="34535545-332f-47ea-b110-74b5f957388e">
Apr 11 17:07:07 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:07:07 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:07 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:07 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:07 user nova-compute[71063]:   </metadata>
Apr 11 17:07:07 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:07 user nova-compute[71063]:     <system>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="serial">17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</entry>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="uuid">17f03f63-a491-4fd4-a282-a4e9b5b6aa2e</entry>
Apr 11 17:07:07 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:07 user nova-compute[71063]:     </system>
Apr 11 17:07:07 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:07 user nova-compute[71063]:   <os>
Apr 11 17:07:07 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:07 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:07 user nova-compute[71063]:   </os>
Apr 11 17:07:07 user nova-compute[71063]:   <features>
Apr 11 17:07:07 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:07 user nova-compute[71063]:     <apic/>
Apr 11 17:07:07 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:07 user nova-compute[71063]:   </features>
Apr 11 17:07:07 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:07 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:07 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:07 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:07 user nova-compute[71063]:   </clock>
Apr 11 17:07:07 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:07 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:07 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:07 user nova-compute[71063]:   </cpu>
Apr 11 17:07:07 user nova-compute[71063]:   <devices>
Apr 11 17:07:07 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:07 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:07 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk"/>
Apr 11 17:07:07 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:07 user nova-compute[71063]:     </disk>
Apr 11 17:07:07 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:07:07 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:07 user nova-compute[71063]:       <source dev="/dev/sdc"/>
Apr 11 17:07:07 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:07:07 user nova-compute[71063]:       <serial>924a836a-8dba-4bec-aa59-5cc6250874bc</serial>
Apr 11 17:07:07 user nova-compute[71063]:     </disk>
Apr 11 17:07:07 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:07 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:07 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue"/>
Apr 11 17:07:07 user nova-compute[71063]:       <target dev="vdc" bus="virtio"/>
Apr 11 17:07:07 user nova-compute[71063]:       <boot order="1"/>
Apr 11 17:07:07 user nova-compute[71063]:     </disk>
Apr 11 17:07:07 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:07 user nova-compute[71063]:       <mac address="fa:16:3e:70:63:7b"/>
Apr 11 17:07:07 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:07 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:07 user nova-compute[71063]:       <target dev="tap34535545-33"/>
Apr 11 17:07:07 user nova-compute[71063]:     </interface>
Apr 11 17:07:07 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:07 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/console.log" append="off"/>
Apr 11 17:07:07 user nova-compute[71063]:     </serial>
Apr 11 17:07:07 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:07 user nova-compute[71063]:     <video>
Apr 11 17:07:07 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:07 user nova-compute[71063]:     </video>
Apr 11 17:07:07 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:07 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:07 user nova-compute[71063]:     </rng>
Apr 11 17:07:07 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:07 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:07 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:07 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:07 user nova-compute[71063]:   </devices>
Apr 11 17:07:07 user nova-compute[71063]: </domain>
Apr 11 17:07:07 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance destroyed successfully.
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] No VIF found with MAC fa:16:3e:70:63:7b, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:07:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance destroyed successfully.
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b20a003-d5, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:07 user nova-compute[71063]: INFO os_vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:07 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a71bb-dc67-4ef9-b027-a1fb04accb7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:07:07 user nova-compute[71063]: No targets found.
Apr 11 17:07:07 user nova-compute[71063]: iSNS:
Apr 11 17:07:07 user nova-compute[71063]: No targets found.
Apr 11 17:07:07 user nova-compute[71063]: STATIC:
Apr 11 17:07:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:07:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:07:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:07 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:07:07 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:07 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:07 user nova-compute[71063]: FIRMWARE:
Apr 11 17:07:07 user nova-compute[71063]: No targets found.
Apr 11 17:07:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:07:07 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:07:07 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b77cec1-eb30-4875-9d6e-1b5d1ad1c06e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfb2f42-2bf4-4476-b7dd-8f570a0210b9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:07 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec17e17e0>, {}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (87ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:07:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Deleting instance files /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_del
Apr 11 17:07:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Deletion of /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_del complete
Apr 11 17:07:08 user nova-compute[71063]: INFO nova.virt.block_device [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Booting with volume 24daff67-0055-44fd-8be9-acf4b3f77ff5 at /dev/vdb
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.utils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d81f1-ac9f-434f-85d7-d82f9637e791]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d7a72-ca40-47bc-8c60-afa38e2db81f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b77158-1177-4f42-b8b4-a2614f95b549]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77647b55-7cac-4e00-a1b1-6ef42fa71a6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:07:08 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:07:08 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[19caf356-9be6-4205-b56a-d435bbc4f311]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG os_brick.utils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating existing volume attachment record: 8da9c931-a60a-43c8-a607-3a7418770a79 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:09 user nova-compute[71063]: WARNING nova.compute.manager [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state rescuing.
Apr 11 17:07:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:10 user nova-compute[71063]: INFO nova.compute.manager [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] instance snapshotting
Apr 11 17:07:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Beginning live snapshot process
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929.delta 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929.delta 1073741824" returned: 0 in 0.060s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232816.0742695, 180c44cc-172d-4e8c-b4ec-6259e775c404 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:11 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] VM Stopped (Lifecycle Event)
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9ee73ce3-9874-4f33-9b04-376126993d16 None None] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232831.224032, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Resumed (Lifecycle Event)
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232831.2246776, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Started (Lifecycle Event)
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'info_cache' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:11 user nova-compute[71063]: WARNING nova.compute.manager [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state rescued and task_state None.
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:07:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:07:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929.delta /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929.delta /opt/stack/data/nova/instances/snapshots/tmp7rdhwin2/d276a82f7c6546df9733e791ba7a2929" returned: 0 in 0.231s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Snapshot extracted, beginning image upload
Apr 11 17:07:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance destroyed successfully.
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'resources' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG os_vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4b45a7-1e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:12 user nova-compute[71063]: INFO os_vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:07:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7f01ab-2323-4c01-b9f3-63b1bb041da0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:07:13 user nova-compute[71063]: No targets found.
Apr 11 17:07:13 user nova-compute[71063]: iSNS:
Apr 11 17:07:13 user nova-compute[71063]: No targets found.
Apr 11 17:07:13 user nova-compute[71063]: STATIC:
Apr 11 17:07:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:07:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:07:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:07:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:07:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:07:13 user nova-compute[71063]: FIRMWARE:
Apr 11 17:07:13 user nova-compute[71063]: No targets found.
Apr 11 17:07:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:07:13 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:07:13 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4541c5d-264a-4b20-af08-e9cfc61e245a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee34265-8fab-48cd-853d-362a1001ffc5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:13 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:13 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:13 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:13 user nova-compute[71063]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec17e31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd'): ({'sdh'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Removing single pathed devices sdh {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e409e0-20ee-45a1-89ea-921931d8ced3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f30fad4-bd29-40ef-ab89-b838b770b616]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flushing IO for device /dev/sdh {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc7fb9-a256-416a-aba4-f7aeb630ba88]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d6ddb3-9a3f-4489-b80c-d317c54b0e4a]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6b7c6-a6f6-482f-8665-1426617846e2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1730b9-98d5-416b-9eac-f03e1c5d4d5d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]
Apr 11 17:07:13 user nova-compute[71063]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6735726f-6228-4f2f-8156-c07f7e906175]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== disconnect_volume: return (427ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start _get_guest_xml network_info=[{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '04a999a1-2049-4a01-a20c-8ff07115192d', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9628077-d981-481d-a434-92ba15259efd', 'serial': 'c9628077-d981-481d-a434-92ba15259efd'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'numa_topology' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:13 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:13 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:13 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb87fce-2e59-4bab-9d3f-496568b070d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:07:13 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be5039-1a4e-43be-8f78-5884b885e9cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd] added
Apr 11 17:07:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:07:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating image(s)
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8b6c3-74e2-464b-a115-a83b14bbba3d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3288ea27-b3f1-4f8b-8587-2cbc909a6588]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QahesofS {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QahesofS" returned: 0 in 0.078s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e46da9-d4c2-4e31-a730-f5a9728170bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QahesofS'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.188s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20ecc0-0ae7-4baf-aa1c-529c3d44069c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea83ea63-642d-4208-9e5b-121d2e75a780]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk 1073741824" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42b1d84-0502-4ed6-a9f1-fa5c9448ee00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]
Apr 11 17:07:14 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.663s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d751a491-3830-4841-a3bf-23b354c9c615]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=26.49797821044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d873f7-d856-41fa-ad85-9f7db4abfe45]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:14 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.321s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77281207-8682-4643-a460-dc59aa78a8ff]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start _get_guest_xml network_info=[{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '8da9c931-a60a-43c8-a607-3a7418770a79', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fc7677c-cbd9-48e7-be62-2210074bc87a', 'attached_at': '', 'detached_at': '', 'volume_id': '24daff67-0055-44fd-8be9-acf4b3f77ff5', 'serial': '24daff67-0055-44fd-8be9-acf4b3f77ff5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 17:07:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:15 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 17:07:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:07:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.371s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== connect_volume: return (2373ms) {'type': 'block', 'scsi_wwn': '23865373535356430', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865373535356430', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.858s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:16 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:16 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6fe6d3-e34a-43bb-af81-7dbc8e7a4455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:07:16 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'pci_devices' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3070d8-2c11-4ecc-b6c1-4cab00531b5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5] added
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:16 user nova-compute[71063]:   <uuid>d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</uuid>
Apr 11 17:07:16 user nova-compute[71063]:   <name>instance-00000007</name>
Apr 11 17:07:16 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:16 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:16 user nova-compute[71063]:   <metadata>
Apr 11 17:07:16 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:16 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeTestJSON-server-1659221805</nova:name>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:13</nova:creationTime>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:16 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:16 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:user uuid="ac0109eab2dc45fe824a03e2d09fa022">tempest-AttachVolumeTestJSON-1071232138-project-member</nova:user>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:project uuid="3c902eb30be24cc6bd26c0ab7036d037">tempest-AttachVolumeTestJSON-1071232138</nova:project>
Apr 11 17:07:16 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:16 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:16 user nova-compute[71063]:         <nova:port uuid="8b4b45a7-1e14-4c93-a6a9-fe814512cef2">
Apr 11 17:07:16 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:07:16 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:16 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:16 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:16 user nova-compute[71063]:   </metadata>
Apr 11 17:07:16 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:16 user nova-compute[71063]:     <system>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="serial">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="uuid">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:07:16 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:16 user nova-compute[71063]:     </system>
Apr 11 17:07:16 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:16 user nova-compute[71063]:   <os>
Apr 11 17:07:16 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:16 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:16 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:16 user nova-compute[71063]:   </os>
Apr 11 17:07:16 user nova-compute[71063]:   <features>
Apr 11 17:07:16 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:16 user nova-compute[71063]:     <apic/>
Apr 11 17:07:16 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:16 user nova-compute[71063]:   </features>
Apr 11 17:07:16 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:16 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:16 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:16 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:16 user nova-compute[71063]:   </clock>
Apr 11 17:07:16 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:16 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:16 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:16 user nova-compute[71063]:   </cpu>
Apr 11 17:07:16 user nova-compute[71063]:   <devices>
Apr 11 17:07:16 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:16 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:16 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk"/>
Apr 11 17:07:16 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:16 user nova-compute[71063]:     </disk>
Apr 11 17:07:16 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:07:16 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:16 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:07:16 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:07:16 user nova-compute[71063]:       <serial>c9628077-d981-481d-a434-92ba15259efd</serial>
Apr 11 17:07:16 user nova-compute[71063]:     </disk>
Apr 11 17:07:16 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:16 user nova-compute[71063]:       <mac address="fa:16:3e:42:9e:29"/>
Apr 11 17:07:16 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:16 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:16 user nova-compute[71063]:       <target dev="tap8b4b45a7-1e"/>
Apr 11 17:07:16 user nova-compute[71063]:     </interface>
Apr 11 17:07:16 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:16 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/console.log" append="off"/>
Apr 11 17:07:16 user nova-compute[71063]:     </serial>
Apr 11 17:07:16 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:16 user nova-compute[71063]:     <video>
Apr 11 17:07:16 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:16 user nova-compute[71063]:     </video>
Apr 11 17:07:16 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:16 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:16 user nova-compute[71063]:     </rng>
Apr 11 17:07:16 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:16 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:16 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:16 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:16 user nova-compute[71063]:   </devices>
Apr 11 17:07:16 user nova-compute[71063]: </domain>
Apr 11 17:07:16 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77670e59-ff6e-4282-b7a4-1aad781960a8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f2e6e3-b803-462f-b2c6-c01df81bbe9d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRKyqiNw {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fRKyqiNw" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b4d09e-6cc6-492c-bc17-5cfe9b851f38]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fRKyqiNw'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Snapshot image upload complete
Apr 11 17:07:16 user nova-compute[71063]: INFO nova.compute.manager [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Took 6.27 seconds to snapshot the instance on the hypervisor.
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e072efb-ac0a-4ddf-8209-deb3aa733e2a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f76a7b3-f835-46aa-83cc-721ecbc61bbf]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a572b2-baa2-461e-bf58-291f9065bb71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]
Apr 11 17:07:16 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb800e-f2d3-4df9-803f-59626cda0d1d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a86695-305c-4c2b-91d3-e84df6bbd6a3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:16 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.551s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9bf4c-f0bf-4c01-affb-95de77ce6272]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.208s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Cannot resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'migration_context' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:05:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG os_vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4b45a7-1e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b4b45a7-1e, col_values=(('external_ids', {'iface-id': '8b4b45a7-1e14-4c93-a6a9-fe814512cef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9e:29', 'vm-uuid': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:16 user nova-compute[71063]: INFO os_vif [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:07:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.599s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (2458ms) {'type': 'block', 'scsi_wwn': '23132356565393833', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132356565393833', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:17 user nova-compute[71063]:   <uuid>1fc7677c-cbd9-48e7-be62-2210074bc87a</uuid>
Apr 11 17:07:17 user nova-compute[71063]:   <name>instance-00000004</name>
Apr 11 17:07:17 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:17 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:17 user nova-compute[71063]:   <metadata>
Apr 11 17:07:17 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:17 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-745930106</nova:name>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:15</nova:creationTime>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:17 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:17 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:07:17 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:17 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:17 user nova-compute[71063]:         <nova:port uuid="6b20a003-d501-4958-9c8c-567343698e97">
Apr 11 17:07:17 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 17:07:17 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:17 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:17 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:17 user nova-compute[71063]:   </metadata>
Apr 11 17:07:17 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:17 user nova-compute[71063]:     <system>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="serial">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="uuid">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:07:17 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:17 user nova-compute[71063]:     </system>
Apr 11 17:07:17 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:17 user nova-compute[71063]:   <os>
Apr 11 17:07:17 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:17 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:17 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:17 user nova-compute[71063]:   </os>
Apr 11 17:07:17 user nova-compute[71063]:   <features>
Apr 11 17:07:17 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:17 user nova-compute[71063]:     <apic/>
Apr 11 17:07:17 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:17 user nova-compute[71063]:   </features>
Apr 11 17:07:17 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:17 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:17 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:17 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:17 user nova-compute[71063]:   </clock>
Apr 11 17:07:17 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:17 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:17 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:17 user nova-compute[71063]:   </cpu>
Apr 11 17:07:17 user nova-compute[71063]:   <devices>
Apr 11 17:07:17 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:17 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:17 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk"/>
Apr 11 17:07:17 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:17 user nova-compute[71063]:     </disk>
Apr 11 17:07:17 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:07:17 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:17 user nova-compute[71063]:       <source dev="/dev/sde"/>
Apr 11 17:07:17 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:07:17 user nova-compute[71063]:       <serial>24daff67-0055-44fd-8be9-acf4b3f77ff5</serial>
Apr 11 17:07:17 user nova-compute[71063]:     </disk>
Apr 11 17:07:17 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:17 user nova-compute[71063]:       <mac address="fa:16:3e:6d:79:2f"/>
Apr 11 17:07:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:17 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:17 user nova-compute[71063]:       <target dev="tap6b20a003-d5"/>
Apr 11 17:07:17 user nova-compute[71063]:     </interface>
Apr 11 17:07:17 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:17 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log" append="off"/>
Apr 11 17:07:17 user nova-compute[71063]:     </serial>
Apr 11 17:07:17 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:17 user nova-compute[71063]:     <video>
Apr 11 17:07:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:17 user nova-compute[71063]:     </video>
Apr 11 17:07:17 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:17 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:17 user nova-compute[71063]:     </rng>
Apr 11 17:07:17 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:17 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:17 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:17 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:17 user nova-compute[71063]:   </devices>
Apr 11 17:07:17 user nova-compute[71063]: </domain>
Apr 11 17:07:17 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG os_vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b20a003-d5, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b20a003-d5, col_values=(('external_ids', {'iface-id': '6b20a003-d501-4958-9c8c-567343698e97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:79:2f', 'vm-uuid': '1fc7677c-cbd9-48e7-be62-2210074bc87a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:17 user nova-compute[71063]: INFO os_vif [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:6d:79:2f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:19 user nova-compute[71063]: WARNING nova.compute.manager [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state powering-on.
Apr 11 17:07:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:07:19 user nova-compute[71063]: INFO nova.compute.claims [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Claim successful on node user
Apr 11 17:07:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:07:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:20 user nova-compute[71063]: WARNING nova.compute.manager [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:07:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Creating image(s)
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "/opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "/opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "/opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232825.9087086, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:20 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Stopped (Lifecycle Event)
Apr 11 17:07:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a6bc4c90-ed55-431e-ae57-a7f0bee40088 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG nova.policy [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:21 user nova-compute[71063]: WARNING nova.compute.manager [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state powering-on.
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.part --force-share --output=json" returned: 0 in 0.277s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG nova.virt.images [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 17bbf027-fa96-46ed-80c2-65e5f74cbbd2 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.part /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.part /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.converted" returned: 0 in 0.300s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.760s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:22 user nova-compute[71063]: WARNING nova.compute.manager [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json" returned: 0 in 0.229s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json" returned: 0 in 0.252s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183,backing_fmt=raw /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232843.1310132, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Resumed (Lifecycle Event)
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183,backing_fmt=raw /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk 1073741824" returned: 0 in 0.057s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "d4de3c6092ab0f9fe5cfeb0d363687fb3df56183" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance rebooted successfully.
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232843.1317332, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Started (Lifecycle Event)
Apr 11 17:07:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d4de3c6092ab0f9fe5cfeb0d363687fb3df56183 --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'migration_context' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Ensure instance console log exists: /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232843.4027097, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Resumed (Lifecycle Event)
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance spawned successfully.
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232843.4055781, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Started (Lifecycle Event)
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:23 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71063) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 17:07:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.135s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Successfully created port: 24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:07:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Successfully updated port: 24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquired lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing instance network info cache due to event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Acquiring lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Releasing lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Instance network_info: |[{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Acquired lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Start _get_guest_xml network_info=[{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5bca52dee6eec5128c206f1c3ed11875',container_format='bare',created_at=2023-04-11T17:07:10Z,direct_url=<?>,disk_format='qcow2',id=17bbf027-fa96-46ed-80c2-65e5f74cbbd2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-914262045',owner='ec4085a617084465ae810ff06498f992',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T17:07:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '17bbf027-fa96-46ed-80c2-65e5f74cbbd2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5bca52dee6eec5128c206f1c3ed11875',container_format='bare',created_at=2023-04-11T17:07:10Z,direct_url=<?>,disk_format='qcow2',id=17bbf027-fa96-46ed-80c2-65e5f74cbbd2,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-914262045',owner='ec4085a617084465ae810ff06498f992',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T17:07:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1895242332',display_name='tempest-TestStampPattern-server-1895242332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1895242332',id=16,image_ref='17bbf027-fa96-46ed-80c2-65e5f74cbbd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-r0ojd597',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9339e177-6264-4942-9dd1-372681209790',image_min_disk='1',image_min_ram='0',image_owner_id='ec4085a617084465ae810ff06498f992',image_owner_project_name='tempest-TestStampPattern-1846780226',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1846780226-project-member',image_user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',network_allocated='True',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:21Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=43b7642b-356d-4122-b006-fe7681192995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.objects.instance [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'pci_devices' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:27 user nova-compute[71063]:   <uuid>43b7642b-356d-4122-b006-fe7681192995</uuid>
Apr 11 17:07:27 user nova-compute[71063]:   <name>instance-00000010</name>
Apr 11 17:07:27 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:27 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:27 user nova-compute[71063]:   <metadata>
Apr 11 17:07:27 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:27 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:name>tempest-TestStampPattern-server-1895242332</nova:name>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:27</nova:creationTime>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:27 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:27 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:user uuid="1f7d3b94cc6b4a7d95489d7d4cf6e297">tempest-TestStampPattern-1846780226-project-member</nova:user>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:project uuid="ec4085a617084465ae810ff06498f992">tempest-TestStampPattern-1846780226</nova:project>
Apr 11 17:07:27 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:root type="image" uuid="17bbf027-fa96-46ed-80c2-65e5f74cbbd2"/>
Apr 11 17:07:27 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:27 user nova-compute[71063]:         <nova:port uuid="24930491-6f3c-445d-ad6b-c4d37775783a">
Apr 11 17:07:27 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 17:07:27 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:27 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:27 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:27 user nova-compute[71063]:   </metadata>
Apr 11 17:07:27 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:27 user nova-compute[71063]:     <system>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="serial">43b7642b-356d-4122-b006-fe7681192995</entry>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="uuid">43b7642b-356d-4122-b006-fe7681192995</entry>
Apr 11 17:07:27 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:27 user nova-compute[71063]:     </system>
Apr 11 17:07:27 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:27 user nova-compute[71063]:   <os>
Apr 11 17:07:27 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:27 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:27 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:27 user nova-compute[71063]:   </os>
Apr 11 17:07:27 user nova-compute[71063]:   <features>
Apr 11 17:07:27 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:27 user nova-compute[71063]:     <apic/>
Apr 11 17:07:27 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:27 user nova-compute[71063]:   </features>
Apr 11 17:07:27 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:27 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:27 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:27 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:27 user nova-compute[71063]:   </clock>
Apr 11 17:07:27 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:27 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:27 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:27 user nova-compute[71063]:   </cpu>
Apr 11 17:07:27 user nova-compute[71063]:   <devices>
Apr 11 17:07:27 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:27 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:27 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk"/>
Apr 11 17:07:27 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:27 user nova-compute[71063]:     </disk>
Apr 11 17:07:27 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:27 user nova-compute[71063]:       <mac address="fa:16:3e:72:6a:49"/>
Apr 11 17:07:27 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:27 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:27 user nova-compute[71063]:       <target dev="tap24930491-6f"/>
Apr 11 17:07:27 user nova-compute[71063]:     </interface>
Apr 11 17:07:27 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:27 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/console.log" append="off"/>
Apr 11 17:07:27 user nova-compute[71063]:     </serial>
Apr 11 17:07:27 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:27 user nova-compute[71063]:     <video>
Apr 11 17:07:27 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:27 user nova-compute[71063]:     </video>
Apr 11 17:07:27 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:27 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:27 user nova-compute[71063]:     </rng>
Apr 11 17:07:27 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:27 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:27 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:27 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:27 user nova-compute[71063]:   </devices>
Apr 11 17:07:27 user nova-compute[71063]: </domain>
Apr 11 17:07:27 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1895242332',display_name='tempest-TestStampPattern-server-1895242332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1895242332',id=16,image_ref='17bbf027-fa96-46ed-80c2-65e5f74cbbd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-r0ojd597',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9339e177-6264-4942-9dd1-372681209790',image_min_disk='1',image_min_ram='0',image_owner_id='ec4085a617084465ae810ff06498f992',image_owner_project_name='tempest-TestStampPattern-1846780226',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1846780226-project-member',image_user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',network_allocated='True',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:21Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=43b7642b-356d-4122-b006-fe7681192995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG os_vif [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24930491-6f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24930491-6f, col_values=(('external_ids', {'iface-id': '24930491-6f3c-445d-ad6b-c4d37775783a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:6a:49', 'vm-uuid': '43b7642b-356d-4122-b006-fe7681192995'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:27 user nova-compute[71063]: INFO os_vif [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f')
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No VIF found with MAC fa:16:3e:72:6a:49, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updated VIF entry in instance network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:07:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Releasing lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] No waiting events found dispatching network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:29 user nova-compute[71063]: WARNING nova.compute.manager [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received unexpected event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a for instance with vm_state building and task_state spawning.
Apr 11 17:07:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] No waiting events found dispatching network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:31 user nova-compute[71063]: WARNING nova.compute.manager [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received unexpected event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a for instance with vm_state building and task_state spawning.
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232852.1608372, 43b7642b-356d-4122-b006-fe7681192995 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] VM Resumed (Lifecycle Event)
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] Instance spawned successfully.
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232852.160946, 43b7642b-356d-4122-b006-fe7681192995 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] VM Started (Lifecycle Event)
Apr 11 17:07:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Took 11.45 seconds to spawn the instance on the hypervisor.
Apr 11 17:07:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:32 user nova-compute[71063]: INFO nova.compute.manager [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Took 12.56 seconds to build instance.
Apr 11 17:07:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.716s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:07:33 user nova-compute[71063]: INFO nova.compute.claims [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Claim successful on node user
Apr 11 17:07:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.624s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:07:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:33 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:07:33 user nova-compute[71063]: INFO nova.compute.claims [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Claim successful on node user
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:07:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Creating image(s)
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "/opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "/opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.policy [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.197s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk 1073741824" returned: 0 in 0.060s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.207s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Cannot resize image /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'migration_context' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Ensure instance console log exists: /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:07:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Successfully created port: 65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:07:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Creating image(s)
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "/opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "/opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG nova.policy [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.186s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk 1073741824" returned: 0 in 0.365s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.561s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Successfully created port: 15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.248s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Successfully updated port: 65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Cannot resize image /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'migration_context' on Instance uuid c5bb4495-9a2d-4903-8158-c57b78e43705 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquired lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Ensure instance console log exists: /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-changed-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Refreshing instance network info cache due to event network-changed-65b16011-5edc-4a36-9493-4ad587afbc19. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Acquiring lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:07:36 user nova-compute[71063]: INFO nova.compute.claims [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Claim successful on node user
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Updating instance_info_cache with network_info: [{"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Releasing lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Instance network_info: |[{"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Acquired lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Refreshing network info cache for port 65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Start _get_guest_xml network_info=[{"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:36 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:36 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-626401967',display_name='tempest-VolumesSnapshotTestJSON-instance-626401967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-626401967',id=17,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-xxko6749',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:34Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=cfbf4deb-df22-4546-b215-61afb77efcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'pci_devices' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:36 user nova-compute[71063]:   <uuid>cfbf4deb-df22-4546-b215-61afb77efcc6</uuid>
Apr 11 17:07:36 user nova-compute[71063]:   <name>instance-00000011</name>
Apr 11 17:07:36 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:36 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:36 user nova-compute[71063]:   <metadata>
Apr 11 17:07:36 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:36 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-626401967</nova:name>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:36</nova:creationTime>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:36 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:36 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:user uuid="2878fecd141a4c0f97ead618b9cfdcbf">tempest-VolumesSnapshotTestJSON-1455403265-project-member</nova:user>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:project uuid="3ab7d4c5adc544ef9ed9f774e1e144cc">tempest-VolumesSnapshotTestJSON-1455403265</nova:project>
Apr 11 17:07:36 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:36 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:36 user nova-compute[71063]:         <nova:port uuid="65b16011-5edc-4a36-9493-4ad587afbc19">
Apr 11 17:07:36 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 17:07:36 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:36 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:36 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:36 user nova-compute[71063]:   </metadata>
Apr 11 17:07:36 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:36 user nova-compute[71063]:     <system>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="serial">cfbf4deb-df22-4546-b215-61afb77efcc6</entry>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="uuid">cfbf4deb-df22-4546-b215-61afb77efcc6</entry>
Apr 11 17:07:36 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:36 user nova-compute[71063]:     </system>
Apr 11 17:07:36 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:36 user nova-compute[71063]:   <os>
Apr 11 17:07:36 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:36 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:36 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:36 user nova-compute[71063]:   </os>
Apr 11 17:07:36 user nova-compute[71063]:   <features>
Apr 11 17:07:36 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:36 user nova-compute[71063]:     <apic/>
Apr 11 17:07:36 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:36 user nova-compute[71063]:   </features>
Apr 11 17:07:36 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:36 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:36 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:36 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:36 user nova-compute[71063]:   </clock>
Apr 11 17:07:36 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:36 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:36 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:36 user nova-compute[71063]:   </cpu>
Apr 11 17:07:36 user nova-compute[71063]:   <devices>
Apr 11 17:07:36 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:36 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:36 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk"/>
Apr 11 17:07:36 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:36 user nova-compute[71063]:     </disk>
Apr 11 17:07:36 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:36 user nova-compute[71063]:       <mac address="fa:16:3e:38:f2:d7"/>
Apr 11 17:07:36 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:36 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:36 user nova-compute[71063]:       <target dev="tap65b16011-5e"/>
Apr 11 17:07:36 user nova-compute[71063]:     </interface>
Apr 11 17:07:36 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:36 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/console.log" append="off"/>
Apr 11 17:07:36 user nova-compute[71063]:     </serial>
Apr 11 17:07:36 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:36 user nova-compute[71063]:     <video>
Apr 11 17:07:36 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:36 user nova-compute[71063]:     </video>
Apr 11 17:07:36 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:36 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:36 user nova-compute[71063]:     </rng>
Apr 11 17:07:36 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:36 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:36 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:36 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:36 user nova-compute[71063]:   </devices>
Apr 11 17:07:36 user nova-compute[71063]: </domain>
Apr 11 17:07:36 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-626401967',display_name='tempest-VolumesSnapshotTestJSON-instance-626401967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-626401967',id=17,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-xxko6749',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:34Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=cfbf4deb-df22-4546-b215-61afb77efcc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG os_vif [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Successfully updated port: 15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65b16011-5e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65b16011-5e, col_values=(('external_ids', {'iface-id': '65b16011-5edc-4a36-9493-4ad587afbc19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:f2:d7', 'vm-uuid': 'cfbf4deb-df22-4546-b215-61afb77efcc6'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquired lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:37 user nova-compute[71063]: INFO os_vif [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e')
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-changed-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Refreshing instance network info cache due to event network-changed-15355548-ee2d-4cc0-abd1-44a292fa87dc. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Acquiring lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No VIF found with MAC fa:16:3e:38:f2:d7, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.884s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Updated VIF entry in instance network info cache for port 65b16011-5edc-4a36-9493-4ad587afbc19. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Updating instance_info_cache with network_info: [{"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Releasing lock "refresh_cache-cfbf4deb-df22-4546-b215-61afb77efcc6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updating instance_info_cache with network_info: [{"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Releasing lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Instance network_info: |[{"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Acquired lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Refreshing network info cache for port 15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Start _get_guest_xml network_info=[{"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:07:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567354548',display_name='tempest-ServersNegativeTestJSON-server-567354548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567354548',id=18,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-qaqfxllv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:35Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=c5bb4495-9a2d-4903-8158-c57b78e43705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'pci_devices' on Instance uuid c5bb4495-9a2d-4903-8158-c57b78e43705 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:37 user nova-compute[71063]:   <uuid>c5bb4495-9a2d-4903-8158-c57b78e43705</uuid>
Apr 11 17:07:37 user nova-compute[71063]:   <name>instance-00000012</name>
Apr 11 17:07:37 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:37 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:37 user nova-compute[71063]:   <metadata>
Apr 11 17:07:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:37 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:name>tempest-ServersNegativeTestJSON-server-567354548</nova:name>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:37</nova:creationTime>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:37 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:37 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:user uuid="d0c53186c18940aba415e0b999cbc2a0">tempest-ServersNegativeTestJSON-1657059206-project-member</nova:user>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:project uuid="d1c61fd594564317a51c9dadebbba6c7">tempest-ServersNegativeTestJSON-1657059206</nova:project>
Apr 11 17:07:37 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:37 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:37 user nova-compute[71063]:         <nova:port uuid="15355548-ee2d-4cc0-abd1-44a292fa87dc">
Apr 11 17:07:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:07:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:37 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:37 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:37 user nova-compute[71063]:   </metadata>
Apr 11 17:07:37 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:37 user nova-compute[71063]:     <system>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="serial">c5bb4495-9a2d-4903-8158-c57b78e43705</entry>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="uuid">c5bb4495-9a2d-4903-8158-c57b78e43705</entry>
Apr 11 17:07:37 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:37 user nova-compute[71063]:     </system>
Apr 11 17:07:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:37 user nova-compute[71063]:   <os>
Apr 11 17:07:37 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:37 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:37 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:37 user nova-compute[71063]:   </os>
Apr 11 17:07:37 user nova-compute[71063]:   <features>
Apr 11 17:07:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:37 user nova-compute[71063]:     <apic/>
Apr 11 17:07:37 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:37 user nova-compute[71063]:   </features>
Apr 11 17:07:37 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:37 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:37 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:37 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:37 user nova-compute[71063]:   </clock>
Apr 11 17:07:37 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:37 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:37 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:37 user nova-compute[71063]:   </cpu>
Apr 11 17:07:37 user nova-compute[71063]:   <devices>
Apr 11 17:07:37 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:37 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:37 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk"/>
Apr 11 17:07:37 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:37 user nova-compute[71063]:     </disk>
Apr 11 17:07:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:37 user nova-compute[71063]:       <mac address="fa:16:3e:72:50:8f"/>
Apr 11 17:07:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:37 user nova-compute[71063]:       <target dev="tap15355548-ee"/>
Apr 11 17:07:37 user nova-compute[71063]:     </interface>
Apr 11 17:07:37 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:37 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/console.log" append="off"/>
Apr 11 17:07:37 user nova-compute[71063]:     </serial>
Apr 11 17:07:37 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:37 user nova-compute[71063]:     <video>
Apr 11 17:07:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:37 user nova-compute[71063]:     </video>
Apr 11 17:07:37 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:37 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:37 user nova-compute[71063]:     </rng>
Apr 11 17:07:37 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:37 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:37 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:37 user nova-compute[71063]:   </devices>
Apr 11 17:07:37 user nova-compute[71063]: </domain>
Apr 11 17:07:37 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567354548',display_name='tempest-ServersNegativeTestJSON-server-567354548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567354548',id=18,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-qaqfxllv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:35Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=c5bb4495-9a2d-4903-8158-c57b78e43705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG os_vif [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG nova.policy [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:07:37 user nova-compute[71063]: INFO nova.virt.block_device [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Booting with volume fbbb37a6-c422-4ef3-98c9-e208a1934805 at /dev/vda
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15355548-ee, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15355548-ee, col_values=(('external_ids', {'iface-id': '15355548-ee2d-4cc0-abd1-44a292fa87dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:50:8f', 'vm-uuid': 'c5bb4495-9a2d-4903-8158-c57b78e43705'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:37 user nova-compute[71063]: INFO os_vif [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee')
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] No VIF found with MAC fa:16:3e:72:50:8f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.utils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[df91c9d1-9e2e-4b47-b761-1e3cba4a866e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6244a1-176e-4b6a-acd1-e3d3610faf93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.039s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c6323-82b8-4d09-a32d-f0fca43100a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d95c487-ce85-4401-bf29-dc0bac69a826]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:07:38 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4cd9ba-951d-4aa7-9ce8-d7b10265de75]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG os_brick.utils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating existing volume attachment record: ea8914a4-da71-4870-9163-1f64938c6fd1 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updated VIF entry in instance network info cache for port 15355548-ee2d-4cc0-abd1-44a292fa87dc. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updating instance_info_cache with network_info: [{"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Releasing lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Successfully created port: fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Successfully updated port: fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing instance network info cache due to event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance network_info: |[{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] No waiting events found dispatching network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:40 user nova-compute[71063]: WARNING nova.compute.manager [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received unexpected event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 for instance with vm_state building and task_state spawning.
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updated VIF entry in instance network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] No waiting events found dispatching network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received unexpected event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc for instance with vm_state building and task_state spawning.
Apr 11 17:07:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] No waiting events found dispatching network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:41 user nova-compute[71063]: WARNING nova.compute.manager [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received unexpected event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc for instance with vm_state building and task_state spawning.
Apr 11 17:07:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] No waiting events found dispatching network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:42 user nova-compute[71063]: WARNING nova.compute.manager [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received unexpected event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 for instance with vm_state building and task_state spawning.
Apr 11 17:07:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Creating image(s)
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Ensure instance console log exists: /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start _get_guest_xml network_info=[{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'ea8914a4-da71-4870-9163-1f64938c6fd1', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dba29188-c963-44d4-95fa-09bffbcb8dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbbb37a6-c422-4ef3-98c9-e208a1934805', 'serial': 'fbbb37a6-c422-4ef3-98c9-e208a1934805'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232863.0570278, cfbf4deb-df22-4546-b215-61afb77efcc6 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] VM Resumed (Lifecycle Event)
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Instance spawned successfully.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:43 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:43 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:07:43 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:43 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:07:43 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232863.0580506, cfbf4deb-df22-4546-b215-61afb77efcc6 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] VM Started (Lifecycle Event)
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Instance spawned successfully.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa7152-1781-4923-ace4-4236b01fec1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:07:43 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232863.0824504, c5bb4495-9a2d-4903-8158-c57b78e43705 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] VM Resumed (Lifecycle Event)
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71aeaa1-559e-4238-8ec0-ae0e27c72150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805] added
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a95726-99ae-47e9-bf5b-889807c9ab5e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Took 9.28 seconds to spawn the instance on the hypervisor.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06ec9f5-615b-4eb6-a3eb-669d49ff7321]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzvRkVNY {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232863.085074, c5bb4495-9a2d-4903-8158-c57b78e43705 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] VM Started (Lifecycle Event)
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Took 8.23 seconds to spawn the instance on the hypervisor.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzvRkVNY" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b884c97a-0e99-4ccc-8830-94f7f81a4d44]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzvRkVNY'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4cfddf-4dc0-4d7b-9e51-0a44bf4b79d6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51772b-9928-4e67-90a7-2dc99acfca57]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Took 10.37 seconds to build instance.
Apr 11 17:07:43 user nova-compute[71063]: INFO nova.compute.manager [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Took 9.54 seconds to build instance.
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.497s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847b197-4554-4e01-9fd6-ddb567118208]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]
Apr 11 17:07:43 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.664s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baccef-6f36-4eb4-9d51-41c0357bfa97]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ee31f-1314-4754-b48f-fb57f617b3df]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:07:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.158s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471475e-1b23-4100-bf13-01f3798b000f]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:07:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.587s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== connect_volume: return (1589ms) {'type': 'block', 'scsi_wwn': '23435393664623563', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435393664623563', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1iD/M9MyvgtRPwRjRcQanIre2nNXOXBvUg4AGkq7sAV6+m5pBZBbB9GJsn7+K0l8XV22PLOcPZAVhc0KhDPSgFmZjERVUBTk3/Eey+mjvEgyssoBy0YWVpHwpdZYxig==',key_name='tempest-TestShelveInstance-1839642534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:38Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'pci_devices' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:44 user nova-compute[71063]:   <uuid>dba29188-c963-44d4-95fa-09bffbcb8dca</uuid>
Apr 11 17:07:44 user nova-compute[71063]:   <name>instance-00000013</name>
Apr 11 17:07:44 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:44 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:44 user nova-compute[71063]:   <metadata>
Apr 11 17:07:44 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:44 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:44 user nova-compute[71063]:       <nova:name>tempest-TestShelveInstance-server-263726245</nova:name>
Apr 11 17:07:44 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:43</nova:creationTime>
Apr 11 17:07:44 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:44 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:44 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:44 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:user uuid="ea404079db924f70b4a22278cee452dc">tempest-TestShelveInstance-720963145-project-member</nova:user>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:project uuid="bf2f734d27a049e7b97ba50db0db0b6c">tempest-TestShelveInstance-720963145</nova:project>
Apr 11 17:07:44 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:44 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:44 user nova-compute[71063]:         <nova:port uuid="fe9d8f85-8c07-4fef-ac72-417df1310bd3">
Apr 11 17:07:44 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 17:07:44 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:44 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:44 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:44 user nova-compute[71063]:   </metadata>
Apr 11 17:07:44 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:44 user nova-compute[71063]:     <system>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="serial">dba29188-c963-44d4-95fa-09bffbcb8dca</entry>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="uuid">dba29188-c963-44d4-95fa-09bffbcb8dca</entry>
Apr 11 17:07:44 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:44 user nova-compute[71063]:     </system>
Apr 11 17:07:44 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:44 user nova-compute[71063]:   <os>
Apr 11 17:07:44 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:44 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:07:44 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:44 user nova-compute[71063]:   </os>
Apr 11 17:07:44 user nova-compute[71063]:   <features>
Apr 11 17:07:44 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:44 user nova-compute[71063]:     <apic/>
Apr 11 17:07:44 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:44 user nova-compute[71063]:   </features>
Apr 11 17:07:44 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:44 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:44 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:44 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:44 user nova-compute[71063]:   </clock>
Apr 11 17:07:44 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:44 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:44 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:44 user nova-compute[71063]:   </cpu>
Apr 11 17:07:44 user nova-compute[71063]:   <devices>
Apr 11 17:07:44 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:07:44 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:07:44 user nova-compute[71063]:       <source dev="/dev/sdf"/>
Apr 11 17:07:44 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:44 user nova-compute[71063]:       <serial>fbbb37a6-c422-4ef3-98c9-e208a1934805</serial>
Apr 11 17:07:44 user nova-compute[71063]:     </disk>
Apr 11 17:07:44 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:44 user nova-compute[71063]:       <mac address="fa:16:3e:fd:41:f9"/>
Apr 11 17:07:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:44 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:44 user nova-compute[71063]:       <target dev="tapfe9d8f85-8c"/>
Apr 11 17:07:44 user nova-compute[71063]:     </interface>
Apr 11 17:07:44 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:44 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca/console.log" append="off"/>
Apr 11 17:07:44 user nova-compute[71063]:     </serial>
Apr 11 17:07:44 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:44 user nova-compute[71063]:     <video>
Apr 11 17:07:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:44 user nova-compute[71063]:     </video>
Apr 11 17:07:44 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:44 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:44 user nova-compute[71063]:     </rng>
Apr 11 17:07:44 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:44 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:44 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:44 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:44 user nova-compute[71063]:   </devices>
Apr 11 17:07:44 user nova-compute[71063]: </domain>
Apr 11 17:07:44 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1iD/M9MyvgtRPwRjRcQanIre2nNXOXBvUg4AGkq7sAV6+m5pBZBbB9GJsn7+K0l8XV22PLOcPZAVhc0KhDPSgFmZjERVUBTk3/Eey+mjvEgyssoBy0YWVpHwpdZYxig==',key_name='tempest-TestShelveInstance-1839642534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:07:38Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG os_vif [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9d8f85-8c, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe9d8f85-8c, col_values=(('external_ids', {'iface-id': 'fe9d8f85-8c07-4fef-ac72-417df1310bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:41:f9', 'vm-uuid': 'dba29188-c963-44d4-95fa-09bffbcb8dca'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:44 user nova-compute[71063]: INFO os_vif [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c')
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] No VIF found with MAC fa:16:3e:fd:41:f9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:46 user nova-compute[71063]: WARNING nova.compute.manager [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state building and task_state spawning.
Apr 11 17:07:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:48 user nova-compute[71063]: WARNING nova.compute.manager [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state building and task_state spawning.
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232868.8230224, dba29188-c963-44d4-95fa-09bffbcb8dca => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Resumed (Lifecycle Event)
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:07:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance spawned successfully.
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:07:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232868.8258507, dba29188-c963-44d4-95fa-09bffbcb8dca => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Started (Lifecycle Event)
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:48 user nova-compute[71063]: INFO nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Took 5.97 seconds to spawn the instance on the hypervisor.
Apr 11 17:07:49 user nova-compute[71063]: DEBUG nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:49 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:07:49 user nova-compute[71063]: INFO nova.compute.manager [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Took 12.76 seconds to build instance.
Apr 11 17:07:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.944s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:52 user nova-compute[71063]: INFO nova.compute.manager [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Rescuing
Apr 11 17:07:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:07:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:07:52 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:07:52 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:07:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:53 user nova-compute[71063]: WARNING nova.compute.manager [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state active and task_state rescuing.
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance destroyed successfully.
Apr 11 17:07:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Attempting rescue
Apr 11 17:07:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:07:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Creating image(s)
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue" returned: 0 in 0.060s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start _get_guest_xml network_info=[{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:d7:35:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'numa_topology' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:54 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:54 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332777263',display_name='tempest-ServerRescueNegativeTestJSON-server-1332777263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1332777263',id=1,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-fu5ob7zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:03:33Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=25935a69-292b-4d55-932c-f4893838998c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:d7:35:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:d7:35:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:07:54 user nova-compute[71063]:   <uuid>25935a69-292b-4d55-932c-f4893838998c</uuid>
Apr 11 17:07:54 user nova-compute[71063]:   <name>instance-00000001</name>
Apr 11 17:07:54 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:07:54 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:07:54 user nova-compute[71063]:   <metadata>
Apr 11 17:07:54 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:07:54 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1332777263</nova:name>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:07:54</nova:creationTime>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:07:54 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:07:54 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:owner>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:07:54 user nova-compute[71063]:       </nova:owner>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:07:54 user nova-compute[71063]:       <nova:ports>
Apr 11 17:07:54 user nova-compute[71063]:         <nova:port uuid="b26876bb-0ee7-42f8-a592-b9078cd9701a">
Apr 11 17:07:54 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 17:07:54 user nova-compute[71063]:         </nova:port>
Apr 11 17:07:54 user nova-compute[71063]:       </nova:ports>
Apr 11 17:07:54 user nova-compute[71063]:     </nova:instance>
Apr 11 17:07:54 user nova-compute[71063]:   </metadata>
Apr 11 17:07:54 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:07:54 user nova-compute[71063]:     <system>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="serial">25935a69-292b-4d55-932c-f4893838998c</entry>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="uuid">25935a69-292b-4d55-932c-f4893838998c</entry>
Apr 11 17:07:54 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:07:54 user nova-compute[71063]:     </system>
Apr 11 17:07:54 user nova-compute[71063]:   </sysinfo>
Apr 11 17:07:54 user nova-compute[71063]:   <os>
Apr 11 17:07:54 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:07:54 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:07:54 user nova-compute[71063]:   </os>
Apr 11 17:07:54 user nova-compute[71063]:   <features>
Apr 11 17:07:54 user nova-compute[71063]:     <acpi/>
Apr 11 17:07:54 user nova-compute[71063]:     <apic/>
Apr 11 17:07:54 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:07:54 user nova-compute[71063]:   </features>
Apr 11 17:07:54 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:07:54 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:07:54 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:07:54 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:07:54 user nova-compute[71063]:   </clock>
Apr 11 17:07:54 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:07:54 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:07:54 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:07:54 user nova-compute[71063]:   </cpu>
Apr 11 17:07:54 user nova-compute[71063]:   <devices>
Apr 11 17:07:54 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:54 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:54 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue"/>
Apr 11 17:07:54 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:07:54 user nova-compute[71063]:     </disk>
Apr 11 17:07:54 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:07:54 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:07:54 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk"/>
Apr 11 17:07:54 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:07:54 user nova-compute[71063]:     </disk>
Apr 11 17:07:54 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:07:54 user nova-compute[71063]:       <mac address="fa:16:3e:d7:35:9d"/>
Apr 11 17:07:54 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:54 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:07:54 user nova-compute[71063]:       <target dev="tapb26876bb-0e"/>
Apr 11 17:07:54 user nova-compute[71063]:     </interface>
Apr 11 17:07:54 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:07:54 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/console.log" append="off"/>
Apr 11 17:07:54 user nova-compute[71063]:     </serial>
Apr 11 17:07:54 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:07:54 user nova-compute[71063]:     <video>
Apr 11 17:07:54 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:07:54 user nova-compute[71063]:     </video>
Apr 11 17:07:54 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:07:54 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:07:54 user nova-compute[71063]:     </rng>
Apr 11 17:07:54 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:07:54 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:07:54 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:07:54 user nova-compute[71063]:     </memballoon>
Apr 11 17:07:54 user nova-compute[71063]:   </devices>
Apr 11 17:07:54 user nova-compute[71063]: </domain>
Apr 11 17:07:54 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:07:54 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance destroyed successfully.
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:d7:35:9d, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:07:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:55 user nova-compute[71063]: WARNING nova.compute.manager [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state active and task_state rescuing.
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:57 user nova-compute[71063]: WARNING nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state active and task_state rescuing.
Apr 11 17:07:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:07:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:07:57 user nova-compute[71063]: WARNING nova.compute.manager [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state active and task_state rescuing.
Apr 11 17:07:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 25935a69-292b-4d55-932c-f4893838998c due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232878.4739947, 25935a69-292b-4d55-932c-f4893838998c => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Resumed (Lifecycle Event)
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232878.4746163, 25935a69-292b-4d55-932c-f4893838998c => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:07:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Started (Lifecycle Event)
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:07:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:07:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:03 user nova-compute[71063]: INFO nova.compute.manager [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Rescuing
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:03 user nova-compute[71063]: WARNING nova.compute.manager [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state active and task_state rescuing.
Apr 11 17:08:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance destroyed successfully.
Apr 11 17:08:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Attempting a stable device rescue
Apr 11 17:08:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:08:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Creating image(s)
Apr 11 17:08:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:05 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.part --force-share --output=json" returned: 0 in 0.264s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.images [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 9ee63b2d-4336-4d8a-b449-9a11e36dd089 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.part /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:06 user nova-compute[71063]: WARNING nova.compute.manager [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state active and task_state rescuing.
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.part /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.converted" returned: 0 in 0.466s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c.converted --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.115s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c,backing_fmt=raw /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c,backing_fmt=raw /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue" returned: 0 in 0.058s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "41aa35f36b62a369da81ac6d8b6fbb30eacb6a7c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'migration_context' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start _get_guest_xml network_info=[{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:d4:9b:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9ee63b2d-4336-4d8a-b449-9a11e36dd089', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '587ae320-df30-40f2-8887-d2490c7da071', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1289fdf8-8842-4e16-80dc-a287bc08fb02', 'attached_at': '', 'detached_at': '', 'volume_id': 'c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'serial': 'c91d72cc-4a7c-493c-992e-ac58f20b3c70'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'numa_topology' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:06 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:06 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:08:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:08:07 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:08:07 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:08:07 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0422acc-9310-4a3f-b7bf-4d8ab7879ca2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vIPDxtjT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 17:08:07 user nova-compute[71063]: node.name = iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:08:07 user nova-compute[71063]: node.tpgt = -1
Apr 11 17:08:07 user nova-compute[71063]: node.startup = automatic
Apr 11 17:08:07 user nova-compute[71063]: node.leading_login = No
Apr 11 17:08:07 user nova-compute[71063]: iface.iscsi_ifacename = default
Apr 11 17:08:07 user nova-compute[71063]: iface.net_ifacename = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.ipaddress = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.prefix_len = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.hwaddress = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.transport_name = tcp
Apr 11 17:08:07 user nova-compute[71063]: iface.initiatorname = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.vlan_id = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.vlan_priority = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.vlan_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.iface_num = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.mtu = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.port = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.bootproto = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.subnet_mask = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.gateway = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_alt_client_id = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_dns = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_learn_iqn = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_vendor_id_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_vendor_id = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.dhcp_slp_da = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.fragmentation = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.gratuitous_arp = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.incoming_forwarding = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.tos_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.tos = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.ttl = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.delayed_ack = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.tcp_nagle = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.tcp_wsf_state = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.tcp_wsf = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.tcp_timer_scale = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.tcp_timestamp = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.redirect = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.def_task_mgmt_timeout = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.header_digest = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.data_digest = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.immediate_data = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.initial_r2t = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.data_seq_inorder = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.data_pdu_inorder = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.erl = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.max_receive_data_len = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.first_burst_len = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.max_outstanding_r2t = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.max_burst_len = 0
Apr 11 17:08:07 user nova-compute[71063]: iface.chap_auth = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.bidi_chap = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.strict_login_compliance = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.discovery_auth = <empty>
Apr 11 17:08:07 user nova-compute[71063]: iface.discovery_logout = <empty>
Apr 11 17:08:07 user nova-compute[71063]: node.discovery_address = <empty>
Apr 11 17:08:07 user nova-compute[71063]: node.discovery_port = 0
Apr 11 17:08:07 user nova-compute[71063]: node.discovery_type = static
Apr 11 17:08:07 user nova-compute[71063]: node.session.initial_cmdsn = 0
Apr 11 17:08:07 user nova-compute[71063]: node.session.initial_login_retry_max = 8
Apr 11 17:08:07 user nova-compute[71063]: node.session.xmit_thread_priority = -20
Apr 11 17:08:07 user nova-compute[71063]: node.session.cmds_max = 128
Apr 11 17:08:07 user nova-compute[71063]: node.session.queue_depth = 32
Apr 11 17:08:07 user nova-compute[71063]: node.session.nr_sessions = 1
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.authmethod = CHAP
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.username = vIPDxtjT
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.password = ***
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.username_in = <empty>
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.password_in = <empty>
Apr 11 17:08:07 user nova-compute[71063]: node.session.auth.chap_algs = MD5
Apr 11 17:08:07 user nova-compute[71063]: node.session.timeo.replacement_timeout = 120
Apr 11 17:08:07 user nova-compute[71063]: node.session.err_timeo.abort_timeout = 15
Apr 11 17:08:07 user nova-compute[71063]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 17:08:07 user nova-compute[71063]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 17:08:07 user nova-compute[71063]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.FastAbort = Yes
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.InitialR2T = No
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.ImmediateData = Yes
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.MaxConnections = 1
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 17:08:07 user nova-compute[71063]: node.session.iscsi.ERL = 0
Apr 11 17:08:07 user nova-compute[71063]: node.session.scan = manual
Apr 11 17:08:07 user nova-compute[71063]: node.session.reopen_max = 0
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].address = 172.16.0.220
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].port = 3260
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].startup = manual
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].tcp.window_size = 524288
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].tcp.type_of_service = 0
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].timeo.logout_timeout = 15
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].timeo.login_timeout = 15
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].timeo.auth_timeout = 45
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.DataDigest = None
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.IFMarker = No
Apr 11 17:08:07 user nova-compute[71063]: node.conn[0].iscsi.OFMarker = No
Apr 11 17:08:07 user nova-compute[71063]: # END RECORD
Apr 11 17:08:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[205f75a7-c5b2-4c6b-8a77-0e757d978e7a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1a7d28-0e52-49cf-bdf8-84e68afda2ee]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIPDxtjT {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIPDxtjT" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a99a3c-09a0-45df-8d87-53eec5c967ba]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIPDxtjT'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf49867-f3e5-4c6d-bdb0-baa387da117a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b2b77f-5490-4ad2-9e23-fcf4559d359e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:08:07 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa27fb-df8b-4ddc-a9e6-970a67483c48]: (4, ('0 0 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.221s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '23338613435313265', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613435313265', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291128519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291128519',id=14,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-7w7db0fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:06:29Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=1289fdf8-8842-4e16-80dc-a287bc08fb02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:d4:9b:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:d4:9b:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:08:07 user nova-compute[71063]:   <uuid>1289fdf8-8842-4e16-80dc-a287bc08fb02</uuid>
Apr 11 17:08:07 user nova-compute[71063]:   <name>instance-0000000e</name>
Apr 11 17:08:07 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:08:07 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:08:07 user nova-compute[71063]:   <metadata>
Apr 11 17:08:07 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:08:07 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1291128519</nova:name>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:08:06</nova:creationTime>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:08:07 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:08:07 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:owner>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:08:07 user nova-compute[71063]:       </nova:owner>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:08:07 user nova-compute[71063]:       <nova:ports>
Apr 11 17:08:07 user nova-compute[71063]:         <nova:port uuid="67d00c4b-a9a1-4ac1-8df9-e7fd43a17056">
Apr 11 17:08:07 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:08:07 user nova-compute[71063]:         </nova:port>
Apr 11 17:08:07 user nova-compute[71063]:       </nova:ports>
Apr 11 17:08:07 user nova-compute[71063]:     </nova:instance>
Apr 11 17:08:07 user nova-compute[71063]:   </metadata>
Apr 11 17:08:07 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:08:07 user nova-compute[71063]:     <system>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="serial">1289fdf8-8842-4e16-80dc-a287bc08fb02</entry>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="uuid">1289fdf8-8842-4e16-80dc-a287bc08fb02</entry>
Apr 11 17:08:07 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:08:07 user nova-compute[71063]:     </system>
Apr 11 17:08:07 user nova-compute[71063]:   </sysinfo>
Apr 11 17:08:07 user nova-compute[71063]:   <os>
Apr 11 17:08:07 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:08:07 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:08:07 user nova-compute[71063]:   </os>
Apr 11 17:08:07 user nova-compute[71063]:   <features>
Apr 11 17:08:07 user nova-compute[71063]:     <acpi/>
Apr 11 17:08:07 user nova-compute[71063]:     <apic/>
Apr 11 17:08:07 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:08:07 user nova-compute[71063]:   </features>
Apr 11 17:08:07 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:08:07 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:08:07 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:08:07 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:08:07 user nova-compute[71063]:   </clock>
Apr 11 17:08:07 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:08:07 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:08:07 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:08:07 user nova-compute[71063]:   </cpu>
Apr 11 17:08:07 user nova-compute[71063]:   <devices>
Apr 11 17:08:07 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:08:07 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:08:07 user nova-compute[71063]:       <source dev="/dev/sdb"/>
Apr 11 17:08:07 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:08:07 user nova-compute[71063]:       <serial>c91d72cc-4a7c-493c-992e-ac58f20b3c70</serial>
Apr 11 17:08:07 user nova-compute[71063]:     </disk>
Apr 11 17:08:07 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:08:07 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:08:07 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue"/>
Apr 11 17:08:07 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:08:07 user nova-compute[71063]:       <boot order="1"/>
Apr 11 17:08:07 user nova-compute[71063]:     </disk>
Apr 11 17:08:07 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:08:07 user nova-compute[71063]:       <mac address="fa:16:3e:d4:9b:bc"/>
Apr 11 17:08:07 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:08:07 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:08:07 user nova-compute[71063]:       <target dev="tap67d00c4b-a9"/>
Apr 11 17:08:07 user nova-compute[71063]:     </interface>
Apr 11 17:08:07 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:08:07 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/console.log" append="off"/>
Apr 11 17:08:07 user nova-compute[71063]:     </serial>
Apr 11 17:08:07 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:08:07 user nova-compute[71063]:     <video>
Apr 11 17:08:07 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:08:07 user nova-compute[71063]:     </video>
Apr 11 17:08:07 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:08:07 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:08:07 user nova-compute[71063]:     </rng>
Apr 11 17:08:07 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:08:07 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:08:07 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:08:07 user nova-compute[71063]:     </memballoon>
Apr 11 17:08:07 user nova-compute[71063]:   </devices>
Apr 11 17:08:07 user nova-compute[71063]: </domain>
Apr 11 17:08:07 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:08:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance destroyed successfully.
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:08:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:d4:9b:bc, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:08:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:09 user nova-compute[71063]: WARNING nova.compute.manager [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state active and task_state rescuing.
Apr 11 17:08:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:11 user nova-compute[71063]: WARNING nova.compute.manager [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state active and task_state rescuing.
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 1289fdf8-8842-4e16-80dc-a287bc08fb02 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232891.372417, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Resumed (Lifecycle Event)
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232891.3773448, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Started (Lifecycle Event)
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:11 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 17:08:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:15 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:17 user nova-compute[71063]: INFO nova.compute.manager [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Terminating instance
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-unplugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] No waiting events found dispatching network-vif-unplugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-unplugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:18 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Instance destroyed successfully.
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'resources' on Instance uuid d136c0bb-535b-4d89-ba3a-a1306e0c8f1b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1508615167',display_name='tempest-VolumesAdminNegativeTest-server-1508615167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1508615167',id=15,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:06:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-bklesfdm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:06:31Z,user_data=None,user_id='d111d892e2944f279a36622978b2dd06',uuid=d136c0bb-535b-4d89-ba3a-a1306e0c8f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "address": "fa:16:3e:4f:cf:e2", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84508dcf-4b", "ovs_interfaceid": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG os_vif [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84508dcf-4b, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:08:18 user nova-compute[71063]: INFO os_vif [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:cf:e2,bridge_name='br-int',has_traffic_filtering=True,id=84508dcf-4b2a-4a8c-807f-12f73bf1fa0f,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84508dcf-4b')
Apr 11 17:08:18 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Deleting instance files /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b_del
Apr 11 17:08:18 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Deletion of /opt/stack/data/nova/instances/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b_del complete
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: INFO nova.compute.manager [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:08:18 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'd136c0bb-535b-4d89-ba3a-a1306e0c8f1b' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd136c0bb-535b-4d89-ba3a-a1306e0c8f1b' (instance-0000000f)
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Took 1.00 seconds to deallocate network for instance.
Apr 11 17:08:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-deleted-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Acquiring lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] No waiting events found dispatching network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:19 user nova-compute[71063]: WARNING nova.compute.manager [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Received unexpected event network-vif-plugged-84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance with vm_state deleted and task_state None.
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Deleted allocations for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.951s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=6966MB free_disk=26.22168731689453GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:08:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 43b7642b-356d-4122-b006-fe7681192995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance cfbf4deb-df22-4546-b215-61afb77efcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance dba29188-c963-44d4-95fa-09bffbcb8dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:08:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.101s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:33 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232898.174747, d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:33 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] VM Stopped (Lifecycle Event)
Apr 11 17:08:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-84464c15-6a9f-445f-9524-276386bca289 None None] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:08:42 user nova-compute[71063]: INFO nova.compute.claims [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Claim successful on node user
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:08:42 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.policy [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f637a2235ae447dc83dc4b2eb5554bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39994062d984774a3755b822f9a2fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:08:42 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Creating image(s)
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "/opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "/opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "/opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk 1073741824" returned: 0 in 0.047s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Successfully created port: 443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Cannot resize image /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lazy-loading 'migration_context' on Instance uuid c689a3c0-b429-49fd-9b20-eb73353ac0b1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Ensure instance console log exists: /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Successfully updated port: 443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquired lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-changed-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Refreshing instance network info cache due to event network-changed-443112af-6269-4e46-b9d5-ee7645b57a4d. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Acquiring lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Updating instance_info_cache with network_info: [{"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Releasing lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Instance network_info: |[{"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Acquired lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Refreshing network info cache for port 443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Start _get_guest_xml network_info=[{"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:08:44 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:44 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753808701',display_name='tempest-VolumesActionsTest-instance-753808701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753808701',id=20,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b39994062d984774a3755b822f9a2fa7',ramdisk_id='',reservation_id='r-7pkpo3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-316903536',owner_user_name='tempest-VolumesActionsTest-316903536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:08:43Z,user_data=None,user_id='f637a2235ae447dc83dc4b2eb5554bff',uuid=c689a3c0-b429-49fd-9b20-eb73353ac0b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converting VIF {"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lazy-loading 'pci_devices' on Instance uuid c689a3c0-b429-49fd-9b20-eb73353ac0b1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:08:44 user nova-compute[71063]:   <uuid>c689a3c0-b429-49fd-9b20-eb73353ac0b1</uuid>
Apr 11 17:08:44 user nova-compute[71063]:   <name>instance-00000014</name>
Apr 11 17:08:44 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:08:44 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:08:44 user nova-compute[71063]:   <metadata>
Apr 11 17:08:44 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:08:44 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:name>tempest-VolumesActionsTest-instance-753808701</nova:name>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:08:44</nova:creationTime>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:08:44 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:08:44 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:owner>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:user uuid="f637a2235ae447dc83dc4b2eb5554bff">tempest-VolumesActionsTest-316903536-project-member</nova:user>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:project uuid="b39994062d984774a3755b822f9a2fa7">tempest-VolumesActionsTest-316903536</nova:project>
Apr 11 17:08:44 user nova-compute[71063]:       </nova:owner>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:08:44 user nova-compute[71063]:       <nova:ports>
Apr 11 17:08:44 user nova-compute[71063]:         <nova:port uuid="443112af-6269-4e46-b9d5-ee7645b57a4d">
Apr 11 17:08:44 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 17:08:44 user nova-compute[71063]:         </nova:port>
Apr 11 17:08:44 user nova-compute[71063]:       </nova:ports>
Apr 11 17:08:44 user nova-compute[71063]:     </nova:instance>
Apr 11 17:08:44 user nova-compute[71063]:   </metadata>
Apr 11 17:08:44 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:08:44 user nova-compute[71063]:     <system>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="serial">c689a3c0-b429-49fd-9b20-eb73353ac0b1</entry>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="uuid">c689a3c0-b429-49fd-9b20-eb73353ac0b1</entry>
Apr 11 17:08:44 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:08:44 user nova-compute[71063]:     </system>
Apr 11 17:08:44 user nova-compute[71063]:   </sysinfo>
Apr 11 17:08:44 user nova-compute[71063]:   <os>
Apr 11 17:08:44 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:08:44 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:08:44 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:08:44 user nova-compute[71063]:   </os>
Apr 11 17:08:44 user nova-compute[71063]:   <features>
Apr 11 17:08:44 user nova-compute[71063]:     <acpi/>
Apr 11 17:08:44 user nova-compute[71063]:     <apic/>
Apr 11 17:08:44 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:08:44 user nova-compute[71063]:   </features>
Apr 11 17:08:44 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:08:44 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:08:44 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:08:44 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:08:44 user nova-compute[71063]:   </clock>
Apr 11 17:08:44 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:08:44 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:08:44 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:08:44 user nova-compute[71063]:   </cpu>
Apr 11 17:08:44 user nova-compute[71063]:   <devices>
Apr 11 17:08:44 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:08:44 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:08:44 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk"/>
Apr 11 17:08:44 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:08:44 user nova-compute[71063]:     </disk>
Apr 11 17:08:44 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:08:44 user nova-compute[71063]:       <mac address="fa:16:3e:36:70:87"/>
Apr 11 17:08:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:08:44 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:08:44 user nova-compute[71063]:       <target dev="tap443112af-62"/>
Apr 11 17:08:44 user nova-compute[71063]:     </interface>
Apr 11 17:08:44 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:08:44 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/console.log" append="off"/>
Apr 11 17:08:44 user nova-compute[71063]:     </serial>
Apr 11 17:08:44 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:08:44 user nova-compute[71063]:     <video>
Apr 11 17:08:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:08:44 user nova-compute[71063]:     </video>
Apr 11 17:08:44 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:08:44 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:08:44 user nova-compute[71063]:     </rng>
Apr 11 17:08:44 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:08:44 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:08:44 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:08:44 user nova-compute[71063]:     </memballoon>
Apr 11 17:08:44 user nova-compute[71063]:   </devices>
Apr 11 17:08:44 user nova-compute[71063]: </domain>
Apr 11 17:08:44 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753808701',display_name='tempest-VolumesActionsTest-instance-753808701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753808701',id=20,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b39994062d984774a3755b822f9a2fa7',ramdisk_id='',reservation_id='r-7pkpo3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-316903536',owner_user_name='tempest-VolumesActionsTest-316903536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:08:43Z,user_data=None,user_id='f637a2235ae447dc83dc4b2eb5554bff',uuid=c689a3c0-b429-49fd-9b20-eb73353ac0b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converting VIF {"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG os_vif [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap443112af-62, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap443112af-62, col_values=(('external_ids', {'iface-id': '443112af-6269-4e46-b9d5-ee7645b57a4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:70:87', 'vm-uuid': 'c689a3c0-b429-49fd-9b20-eb73353ac0b1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:44 user nova-compute[71063]: INFO os_vif [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62')
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:08:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] No VIF found with MAC fa:16:3e:36:70:87, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:08:45 user nova-compute[71063]: DEBUG nova.network.neutron [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Updated VIF entry in instance network info cache for port 443112af-6269-4e46-b9d5-ee7645b57a4d. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:08:45 user nova-compute[71063]: DEBUG nova.network.neutron [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Updating instance_info_cache with network_info: [{"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Releasing lock "refresh_cache-c689a3c0-b429-49fd-9b20-eb73353ac0b1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] No waiting events found dispatching network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:46 user nova-compute[71063]: WARNING nova.compute.manager [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received unexpected event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d for instance with vm_state building and task_state spawning.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232928.154832, c689a3c0-b429-49fd-9b20-eb73353ac0b1 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] VM Resumed (Lifecycle Event)
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Instance spawned successfully.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232928.156129, c689a3c0-b429-49fd-9b20-eb73353ac0b1 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] VM Started (Lifecycle Event)
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Took 5.43 seconds to spawn the instance on the hypervisor.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:48 user nova-compute[71063]: INFO nova.compute.manager [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Took 6.23 seconds to build instance.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] No waiting events found dispatching network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:48 user nova-compute[71063]: WARNING nova.compute.manager [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received unexpected event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d for instance with vm_state active and task_state None.
Apr 11 17:08:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.323s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:53 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:08:53 user nova-compute[71063]: INFO nova.compute.manager [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Unrescuing
Apr 11 17:08:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:53 user nova-compute[71063]: DEBUG nova.network.neutron [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.network.neutron [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'flavor' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:54 user nova-compute[71063]: WARNING nova.compute.manager [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:08:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-changed-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing instance network info cache due to event network-changed-34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:54 user nova-compute[71063]: DEBUG nova.network.neutron [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing network info cache for port 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance destroyed successfully.
Apr 11 17:08:55 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG nova.network.neutron [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updated VIF entry in instance network info cache for port 34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG nova.network.neutron [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:56 user nova-compute[71063]: WARNING nova.compute.manager [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:08:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-changed-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing instance network info cache due to event network-changed-34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Acquiring lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Acquired lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:08:56 user nova-compute[71063]: DEBUG nova.network.neutron [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Refreshing network info cache for port 34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG nova.network.neutron [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updated VIF entry in instance network info cache for port 34535545-332f-47ea-b110-74b5f957388e. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG nova.network.neutron [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [{"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:08:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Releasing lock "refresh_cache-17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232938.5796182, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Resumed (Lifecycle Event)
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232938.5871663, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:08:58 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Started (Lifecycle Event)
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:58 user nova-compute[71063]: WARNING nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state None.
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:08:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:08:58 user nova-compute[71063]: WARNING nova.compute.manager [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state active and task_state None.
Apr 11 17:08:59 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:08:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:01 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:02 user nova-compute[71063]: INFO nova.compute.manager [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Detaching volume c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:09:02 user nova-compute[71063]: INFO nova.virt.block_device [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Attempting to driver detach volume c9628077-d981-481d-a434-92ba15259efd from mountpoint /dev/vdb
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Attempting to detach device vdb from instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:02 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:02 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:09:02 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:02 user nova-compute[71063]:   <serial>c9628077-d981-481d-a434-92ba15259efd</serial>
Apr 11 17:09:02 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:09:02 user nova-compute[71063]: </disk>
Apr 11 17:09:02 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdb from instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 from the persistent domain config.
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:02 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:02 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:09:02 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:02 user nova-compute[71063]:   <serial>c9628077-d981-481d-a434-92ba15259efd</serial>
Apr 11 17:09:02 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:09:02 user nova-compute[71063]: </disk>
Apr 11 17:09:02 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232942.954835, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:09:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdb from instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 from the live domain config.
Apr 11 17:09:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QahesofS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:02 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[771628eb-33bb-4ec7-b881-30cc60c87a38]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:02 user nova-compute[71063]: No targets found.
Apr 11 17:09:02 user nova-compute[71063]: iSNS:
Apr 11 17:09:02 user nova-compute[71063]: No targets found.
Apr 11 17:09:02 user nova-compute[71063]: STATIC:
Apr 11 17:09:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd
Apr 11 17:09:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:09:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:09:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:02 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:02 user nova-compute[71063]: No targets found.
Apr 11 17:09:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:02 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:02 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a9e61-9230-427f-9641-27f1ee7a45e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad3bd5-aa89-4fed-b8fb-b33ef4207ab5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:03 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb411a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[33532991-aba4-4c11-b02a-ca7c0cd573f2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455c674-1095-4826-a699-3e5f38d9d04e]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d1f6d-5dbf-4467-90fb-f4a61f248fcd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ccb091-b1d9-4662-8951-e5711ef7f8cc]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2808ff-a594-4cd2-b943-eef29761a2b0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc905ed7-7660-4751-9f3f-341005655e8b]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260]
Apr 11 17:09:03 user nova-compute[71063]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:03 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9628077-d981-481d-a434-92ba15259efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d56a1-88f5-468b-8a87-f8cd31375d1a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== disconnect_volume: return (324ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.775s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71063) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:05 user nova-compute[71063]: WARNING nova.compute.manager [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state active and task_state powering-off.
Apr 11 17:09:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance destroyed successfully.
Apr 11 17:09:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.879s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:07 user nova-compute[71063]: WARNING nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:07 user nova-compute[71063]: WARNING nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:07 user nova-compute[71063]: WARNING nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:07 user nova-compute[71063]: WARNING nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:07 user nova-compute[71063]: WARNING nova.compute.manager [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state None.
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:09:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:09 user nova-compute[71063]: INFO nova.compute.manager [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Terminating instance
Apr 11 17:09:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-unplugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] No waiting events found dispatching network-vif-unplugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-unplugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Instance destroyed successfully.
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.objects.instance [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'resources' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-758752172',display_name='tempest-VolumesAdminNegativeTest-server-758752172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-758752172',id=9,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXQASF5POVSKT+6Cb9neB2DzmtcARSnrw7alBnxX24AHH7TdoZurn7Zjp47ozOOPlermL7JqhMAZ5O9u9neGe4Or35NaG0Z9zNUT9CetsumcUKjlTrO2prLN5MOqot/oQ==',key_name='tempest-keypair-1343943661',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='381738c7ad99437b875807c4252965bf',ramdisk_id='',reservation_id='r-zp1i6060',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1639987679',owner_user_name='tempest-VolumesAdminNegativeTest-1639987679-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:03:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d111d892e2944f279a36622978b2dd06',uuid=2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converting VIF {"id": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "address": "fa:16:3e:70:3f:0d", "network": {"id": "3d6cedad-ded5-40a1-b6c1-beeb84619510", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-179135712-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "381738c7ad99437b875807c4252965bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68bea989-7c", "ovs_interfaceid": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG os_vif [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68bea989-7c, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:10 user nova-compute[71063]: INFO os_vif [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:3f:0d,bridge_name='br-int',has_traffic_filtering=True,id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93,network=Network(3d6cedad-ded5-40a1-b6c1-beeb84619510),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68bea989-7c')
Apr 11 17:09:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Deleting instance files /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e_del
Apr 11 17:09:10 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Deletion of /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e_del complete
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json" returned: 1 in 0.162s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk --force-share --output=json' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:09:10 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000009, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/disk
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: INFO nova.compute.manager [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:11 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Took 0.84 seconds to deallocate network for instance.
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-deleted-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:11 user nova-compute[71063]: INFO nova.compute.manager [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Neutron deleted interface 68bea989-7c25-4d4d-aa6d-e4fe977ebb93; detaching it from the instance and deleting it from the info cache
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Detach interface failed, port_id=68bea989-7c25-4d4d-aa6d-e4fe977ebb93, reason: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:11 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:09:11 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7072MB free_disk=26.193817138671875GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Acquiring lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] No waiting events found dispatching network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:11 user nova-compute[71063]: WARNING nova.compute.manager [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Received unexpected event network-vif-plugged-68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance with vm_state deleted and task_state None.
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:09:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.582s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:12 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Deleted allocations for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing instance network info cache due to event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Acquiring lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Acquired lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 43b7642b-356d-4122-b006-fe7681192995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance cfbf4deb-df22-4546-b215-61afb77efcc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance dba29188-c963-44d4-95fa-09bffbcb8dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.126s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updated VIF entry in instance network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Releasing lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:12 user nova-compute[71063]: INFO nova.compute.manager [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Attaching volume 0b69b905-7b1c-4197-aeb4-beb66f68d83c to /dev/vdb
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.utils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[56793003-9ed6-481b-b3e2-aee1aeafdfb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5cd4f-ff20-4411-962f-f6613f2b1834]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279904d-2f97-48d8-be4f-ba5e1a2a7020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492dcfb-ce21-4c31-a806-0de8237ab22c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:09:12 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:09:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d4e28a-166c-4a58-8946-7a46fb1c4b65]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG os_brick.utils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:12 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating existing volume attachment record: 7b6668fa-5f44-47b0-9ae3-623574bb7a69 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid c5bb4495-9a2d-4903-8158-c57b78e43705 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid c689a3c0-b429-49fd-9b20-eb73353ac0b1 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "25935a69-292b-4d55-932c-f4893838998c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:13 user nova-compute[71063]: WARNING oslo_messaging._drivers.amqpdriver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "25935a69-292b-4d55-932c-f4893838998c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKFLgEQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:16 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:16 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:16 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab03ddc-f82c-4f0e-868e-f94dd7f12f80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:09:16 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f861c2-5a91-4feb-9a5b-2a08ea1a0f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c] added
Apr 11 17:09:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00abed-42ff-4415-9181-0a8732a17ee6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee10565-5613-4d99-a3ed-a8f686d143ed]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKFLgEQO {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKFLgEQO" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c028739f-9a88-49d4-adba-261a15db737c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKFLgEQO'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d93f493-5b15-450a-b809-552b0691bfaf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ef281-a20f-4684-9aac-356ffaf29de6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d644f38e-da5b-491c-b040-dd7a4a0a1e1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260]
Apr 11 17:09:17 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860e1bf-6a3e-40ee-a7f2-51cc57d196d0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5827d75e-521f-4185-900d-9dc5b4cd134a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)
Apr 11 17:09:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:17 user nova-compute[71063]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)
Apr 11 17:09:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe77135-e2ec-485a-a8c1-e0ab2087b922]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKFLgEQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23465663163316330', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465663163316330', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:09:18 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:18 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:09:18 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:18 user nova-compute[71063]:   <serial>0b69b905-7b1c-4197-aeb4-beb66f68d83c</serial>
Apr 11 17:09:18 user nova-compute[71063]: </disk>
Apr 11 17:09:18 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] No VIF found with MAC fa:16:3e:72:6a:49, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.071s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.042s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:19 user nova-compute[71063]: INFO nova.compute.manager [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Detaching volume 0b69b905-7b1c-4197-aeb4-beb66f68d83c
Apr 11 17:09:19 user nova-compute[71063]: INFO nova.virt.block_device [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Attempting to driver detach volume 0b69b905-7b1c-4197-aeb4-beb66f68d83c from mountpoint /dev/vdb
Apr 11 17:09:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Attempting to detach device vdb from instance 43b7642b-356d-4122-b006-fe7681192995 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:09:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:19 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:09:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:19 user nova-compute[71063]:   <serial>0b69b905-7b1c-4197-aeb4-beb66f68d83c</serial>
Apr 11 17:09:19 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:19 user nova-compute[71063]: </disk>
Apr 11 17:09:19 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully detached device vdb from instance 43b7642b-356d-4122-b006-fe7681192995 from the persistent domain config.
Apr 11 17:09:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43b7642b-356d-4122-b006-fe7681192995 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:09:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:19 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:09:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:19 user nova-compute[71063]:   <serial>0b69b905-7b1c-4197-aeb4-beb66f68d83c</serial>
Apr 11 17:09:19 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:19 user nova-compute[71063]: </disk>
Apr 11 17:09:19 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232960.281248, 43b7642b-356d-4122-b006-fe7681192995 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:09:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully detached device vdb from instance 43b7642b-356d-4122-b006-fe7681192995 from the live domain config.
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKFLgEQO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:20 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc9d5de-ac5d-4342-982d-b14feeefe2e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:20 user nova-compute[71063]: No targets found.
Apr 11 17:09:20 user nova-compute[71063]: iSNS:
Apr 11 17:09:20 user nova-compute[71063]: No targets found.
Apr 11 17:09:20 user nova-compute[71063]: STATIC:
Apr 11 17:09:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c
Apr 11 17:09:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:09:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:09:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:20 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:20 user nova-compute[71063]: No targets found.
Apr 11 17:09:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:20 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:20 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f66dd-7a8f-4fe4-a9af-32d06eb42046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9a1732-05aa-47fb-9a5d-5d2cac47ab65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)
Apr 11 17:09:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:20 user nova-compute[71063]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c (non-flash)
Apr 11 17:09:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb41184c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9cef98-1b44-4649-a2c4-704d33da9dc0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5cf5fe-c3fe-41b1-b00e-2ec0d82b7ea7]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[158f7aaf-b515-4605-8a97-b33ab705e15d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ea11d-2d7b-41ee-a26f-196edbdb9e46]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[07576161-1a04-4347-af1d-3df6a508ac58]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232945.5176501, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:20 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Stopped (Lifecycle Event)
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4929d1b0-e1e3-4285-a3b9-69d2003e2bb7 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4929d1b0-e1e3-4285-a3b9-69d2003e2bb7 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9779c-8253-415f-95c0-fc9dce8546f2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260]
Apr 11 17:09:20 user nova-compute[71063]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b69b905-7b1c-4197-aeb4-beb66f68d83c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d4adb7-9dba-4b0f-8483-9eae2700295a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] <== disconnect_volume: return (339ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'flavor' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.741s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:23 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Ignoring supplied device name: /dev/vdb
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:23 user nova-compute[71063]: INFO nova.compute.manager [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Attaching volume 2cf1c524-aa18-4ad4-8b51-04ecc1def139 to /dev/vdb
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e8653-f620-4ea2-a723-ada3d2fc65b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[801302d8-f75a-4cb4-8abe-1b52de63943d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef03b8-67a1-4396-8c89-a177767add32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b700a-2233-47f5-a9a1-daa761aa48e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:09:23 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:09:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb517ef-a0dd-43ad-ba7c-32af096f08ea]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:23 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Updating existing volume attachment record: c93813ab-3cf1-45d9-bb14-b64650c06eee {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:09:24 user nova-compute[71063]: INFO nova.compute.claims [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Claim successful on node user
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232950.0032437, 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:25 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] VM Stopped (Lifecycle Event)
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1a29c41c-1f78-46c1-b4ba-b01e2dca1461 None None] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:09:25 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.policy [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:09:25 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Creating image(s)
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "/opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "/opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "/opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk 1073741824" returned: 0 in 0.063s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Cannot resize image /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'migration_context' on Instance uuid 351fca73-83de-49b4-91d8-72e3cf45a59c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Ensure instance console log exists: /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Successfully created port: fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:26 user nova-compute[71063]: INFO nova.compute.manager [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Detaching volume 924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:09:26 user nova-compute[71063]: INFO nova.virt.block_device [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Attempting to driver detach volume 924a836a-8dba-4bec-aa59-5cc6250874bc from mountpoint /dev/vdb
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Attempting to detach device vdb from instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:26 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:26 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:09:26 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:26 user nova-compute[71063]:   <serial>924a836a-8dba-4bec-aa59-5cc6250874bc</serial>
Apr 11 17:09:26 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:26 user nova-compute[71063]: </disk>
Apr 11 17:09:26 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:26 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Successfully detached device vdb from instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e from the persistent domain config.
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:09:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:26 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:26 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:09:26 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:26 user nova-compute[71063]:   <serial>924a836a-8dba-4bec-aa59-5cc6250874bc</serial>
Apr 11 17:09:26 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:26 user nova-compute[71063]: </disk>
Apr 11 17:09:26 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232967.268493, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:09:27 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Successfully detached device vdb from instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e from the live domain config.
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZbsYOGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b63f7-e255-4918-a0a6-a64a30e116d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:27 user nova-compute[71063]: No targets found.
Apr 11 17:09:27 user nova-compute[71063]: iSNS:
Apr 11 17:09:27 user nova-compute[71063]: No targets found.
Apr 11 17:09:27 user nova-compute[71063]: STATIC:
Apr 11 17:09:27 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:27 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:27 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:27 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc
Apr 11 17:09:27 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:27 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:27 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:27 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:27 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:27 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:09:27 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:27 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:27 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:27 user nova-compute[71063]: No targets found.
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:27 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:27 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f369c-0b9b-46ed-8698-6b7aa0521526]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2090e934-8d65-4423-9c4e-e19ac650edc4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbea476c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc71e13c-84db-4265-ba21-78870c3b268f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fccdc9-6d3c-435f-b0eb-2c3ca0f47a1a]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[61786b78-10a7-418c-8397-0ef3a767c4cd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2892fe89-be3c-4451-b85c-347bf9fab306]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3a0e1b-9c7a-4349-b1c2-80a60b8e4fb7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e09fa26-2cab-47bc-8a6a-f7dc25e0c125]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260]
Apr 11 17:09:27 user nova-compute[71063]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:924a836a-8dba-4bec-aa59-5cc6250874bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0357be60-a3c7-4901-829e-bbe8289676bc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] <== disconnect_volume: return (332ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAoHhzjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:27 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423e488-c3f9-49b7-b897-9ab5a57af81c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:09:27 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[84861683-619f-43da-ad23-c1b3ad6c0095]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139] added
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.125s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67d2b5d-fa4f-43db-a8b0-feebe29464df]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087e1dd-f9be-4620-a342-128d7637b9b3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAoHhzjT {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAoHhzjT" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1f1c86-3bac-4672-a10a-6040a5f04a59]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAoHhzjT'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b73fb93-7b23-45a7-b9eb-8147cdbee940]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc52321-dee4-4e74-ac5f-7368c31f4f89]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing instance network info cache due to event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:09:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Successfully updated port: fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquired lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[42221c51-52f8-41b4-826c-ce64b4771657]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260]
Apr 11 17:09:28 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-changed-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Refreshing instance network info cache due to event network-changed-fe19475b-d2f0-4f2a-814c-dc6650833ff5. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Acquiring lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac7c92-dc89-4f5b-86b2-9474a37ec270]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1600b2-77cf-464d-9a35-6f440f9a1a5f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77877b0-a5b4-4422-aa86-64226be89f01]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:28 user nova-compute[71063]: INFO nova.compute.manager [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Shelve offloading
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'flavor' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Updating instance_info_cache with network_info: [{"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Releasing lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Instance network_info: |[{"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Acquired lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Refreshing network info cache for port fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Start _get_guest_xml network_info=[{"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:09:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:09:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1556364363',display_name='tempest-ServersNegativeTestJSON-server-1556364363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1556364363',id=21,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-zk0l98nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:09:26Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=351fca73-83de-49b4-91d8-72e3cf45a59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'pci_devices' on Instance uuid 351fca73-83de-49b4-91d8-72e3cf45a59c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:09:28 user nova-compute[71063]:   <uuid>351fca73-83de-49b4-91d8-72e3cf45a59c</uuid>
Apr 11 17:09:28 user nova-compute[71063]:   <name>instance-00000015</name>
Apr 11 17:09:28 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:09:28 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:09:28 user nova-compute[71063]:   <metadata>
Apr 11 17:09:28 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:09:28 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:name>tempest-ServersNegativeTestJSON-server-1556364363</nova:name>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:09:28</nova:creationTime>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:09:28 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:09:28 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:owner>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:user uuid="d0c53186c18940aba415e0b999cbc2a0">tempest-ServersNegativeTestJSON-1657059206-project-member</nova:user>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:project uuid="d1c61fd594564317a51c9dadebbba6c7">tempest-ServersNegativeTestJSON-1657059206</nova:project>
Apr 11 17:09:28 user nova-compute[71063]:       </nova:owner>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:09:28 user nova-compute[71063]:       <nova:ports>
Apr 11 17:09:28 user nova-compute[71063]:         <nova:port uuid="fe19475b-d2f0-4f2a-814c-dc6650833ff5">
Apr 11 17:09:28 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:09:28 user nova-compute[71063]:         </nova:port>
Apr 11 17:09:28 user nova-compute[71063]:       </nova:ports>
Apr 11 17:09:28 user nova-compute[71063]:     </nova:instance>
Apr 11 17:09:28 user nova-compute[71063]:   </metadata>
Apr 11 17:09:28 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:09:28 user nova-compute[71063]:     <system>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="serial">351fca73-83de-49b4-91d8-72e3cf45a59c</entry>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="uuid">351fca73-83de-49b4-91d8-72e3cf45a59c</entry>
Apr 11 17:09:28 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:09:28 user nova-compute[71063]:     </system>
Apr 11 17:09:28 user nova-compute[71063]:   </sysinfo>
Apr 11 17:09:28 user nova-compute[71063]:   <os>
Apr 11 17:09:28 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:09:28 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:09:28 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:09:28 user nova-compute[71063]:   </os>
Apr 11 17:09:28 user nova-compute[71063]:   <features>
Apr 11 17:09:28 user nova-compute[71063]:     <acpi/>
Apr 11 17:09:28 user nova-compute[71063]:     <apic/>
Apr 11 17:09:28 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:09:28 user nova-compute[71063]:   </features>
Apr 11 17:09:28 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:09:28 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:09:28 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:09:28 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:09:28 user nova-compute[71063]:   </clock>
Apr 11 17:09:28 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:09:28 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:09:28 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:09:28 user nova-compute[71063]:   </cpu>
Apr 11 17:09:28 user nova-compute[71063]:   <devices>
Apr 11 17:09:28 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:09:28 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:09:28 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk"/>
Apr 11 17:09:28 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:09:28 user nova-compute[71063]:     </disk>
Apr 11 17:09:28 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:09:28 user nova-compute[71063]:       <mac address="fa:16:3e:2c:22:8b"/>
Apr 11 17:09:28 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:09:28 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:09:28 user nova-compute[71063]:       <target dev="tapfe19475b-d2"/>
Apr 11 17:09:28 user nova-compute[71063]:     </interface>
Apr 11 17:09:28 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:09:28 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/console.log" append="off"/>
Apr 11 17:09:28 user nova-compute[71063]:     </serial>
Apr 11 17:09:28 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:09:28 user nova-compute[71063]:     <video>
Apr 11 17:09:28 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:09:28 user nova-compute[71063]:     </video>
Apr 11 17:09:28 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:09:28 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:09:28 user nova-compute[71063]:     </rng>
Apr 11 17:09:28 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:09:28 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:09:28 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:09:28 user nova-compute[71063]:     </memballoon>
Apr 11 17:09:28 user nova-compute[71063]:   </devices>
Apr 11 17:09:28 user nova-compute[71063]: </domain>
Apr 11 17:09:28 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1556364363',display_name='tempest-ServersNegativeTestJSON-server-1556364363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1556364363',id=21,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-zk0l98nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:09:26Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=351fca73-83de-49b4-91d8-72e3cf45a59c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG os_vif [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe19475b-d2, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe19475b-d2, col_values=(('external_ids', {'iface-id': 'fe19475b-d2f0-4f2a-814c-dc6650833ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:22:8b', 'vm-uuid': '351fca73-83de-49b4-91d8-72e3cf45a59c'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updated VIF entry in instance network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:28 user nova-compute[71063]: INFO os_vif [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2')
Apr 11 17:09:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:09:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] No VIF found with MAC fa:16:3e:2c:22:8b, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAoHhzjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23532316562616239', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532316562616239', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:09:29 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:29 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:09:29 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:29 user nova-compute[71063]:   <serial>2cf1c524-aa18-4ad4-8b51-04ecc1def139</serial>
Apr 11 17:09:29 user nova-compute[71063]: </disk>
Apr 11 17:09:29 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Updated VIF entry in instance network info cache for port fe19475b-d2f0-4f2a-814c-dc6650833ff5. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Updating instance_info_cache with network_info: [{"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Releasing lock "refresh_cache-351fca73-83de-49b4-91d8-72e3cf45a59c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance destroyed successfully.
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:30 user nova-compute[71063]: WARNING nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state active and task_state shelving.
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:30 user nova-compute[71063]: WARNING nova.compute.manager [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state active and task_state shelving.
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No VIF found with MAC fa:16:3e:38:f2:d7, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.986s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance destroyed successfully.
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'resources' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1iD/M9MyvgtRPwRjRcQanIre2nNXOXBvUg4AGkq7sAV6+m5pBZBbB9GJsn7+K0l8XV22PLOcPZAVhc0KhDPSgFmZjERVUBTk3/Eey+mjvEgyssoBy0YWVpHwpdZYxig==',key_name='tempest-TestShelveInstance-1839642534',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:07:49Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_vif [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing instance network info cache due to event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.network.neutron [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9d8f85-8c, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:30 user nova-compute[71063]: INFO os_vif [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c')
Apr 11 17:09:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafeff13-7286-4f07-83c5-c8506041525d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:30 user nova-compute[71063]: No targets found.
Apr 11 17:09:30 user nova-compute[71063]: iSNS:
Apr 11 17:09:30 user nova-compute[71063]: No targets found.
Apr 11 17:09:30 user nova-compute[71063]: STATIC:
Apr 11 17:09:30 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:30 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:30 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:30 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:30 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:30 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:30 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:09:30 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:30 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:30 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139
Apr 11 17:09:30 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:30 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:30 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:30 user nova-compute[71063]: No targets found.
Apr 11 17:09:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:30 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:30 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f2c935-2189-4bf2-826d-36592a9f67b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d308ea28-6799-4e32-8cd5-141e2622c3d4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b3e8e3-903f-4e1a-a05e-be1c6a0722f2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a1c8fb-7604-4ba2-a190-3886d57e46b9]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f9ccd-f98c-4520-b6e8-df7ccc58086b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[051d7997-2afd-4427-8636-26f4e3dc1489]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2be10b-88eb-44e7-9a65-4fe4bc4225ca]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8814168e-1845-45bc-be51-60bbdadbcf43]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]
Apr 11 17:09:31 user nova-compute[71063]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e106306-e086-4a56-90ce-4b2375528012]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== disconnect_volume: return (407ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deleting instance files /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca_del
Apr 11 17:09:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deletion of /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca_del complete
Apr 11 17:09:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updated VIF entry in instance network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": null, "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:32 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Deleted allocations for instance dba29188-c963-44d4-95fa-09bffbcb8dca
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'numa_topology' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] No waiting events found dispatching network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:32 user nova-compute[71063]: WARNING nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received unexpected event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance with vm_state building and task_state spawning.
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] No waiting events found dispatching network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:32 user nova-compute[71063]: WARNING nova.compute.manager [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received unexpected event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance with vm_state building and task_state spawning.
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:09:32 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.737s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232973.1099823, 351fca73-83de-49b4-91d8-72e3cf45a59c => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] VM Resumed (Lifecycle Event)
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Instance spawned successfully.
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232973.110983, 351fca73-83de-49b4-91d8-72e3cf45a59c => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] VM Started (Lifecycle Event)
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Took 7.61 seconds to spawn the instance on the hypervisor.
Apr 11 17:09:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:09:33 user nova-compute[71063]: INFO nova.compute.manager [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Took 8.45 seconds to build instance.
Apr 11 17:09:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.547s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:38 user nova-compute[71063]: INFO nova.compute.manager [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Detaching volume 2cf1c524-aa18-4ad4-8b51-04ecc1def139
Apr 11 17:09:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:38 user nova-compute[71063]: INFO nova.virt.block_device [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Attempting to driver detach volume 2cf1c524-aa18-4ad4-8b51-04ecc1def139 from mountpoint /dev/vdb
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Attempting to detach device vdb from instance cfbf4deb-df22-4546-b215-61afb77efcc6 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:38 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:38 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:09:38 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:38 user nova-compute[71063]:   <serial>2cf1c524-aa18-4ad4-8b51-04ecc1def139</serial>
Apr 11 17:09:38 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:38 user nova-compute[71063]: </disk>
Apr 11 17:09:38 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully detached device vdb from instance cfbf4deb-df22-4546-b215-61afb77efcc6 from the persistent domain config.
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfbf4deb-df22-4546-b215-61afb77efcc6 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:38 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:38 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:09:38 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:38 user nova-compute[71063]:   <serial>2cf1c524-aa18-4ad4-8b51-04ecc1def139</serial>
Apr 11 17:09:38 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:09:38 user nova-compute[71063]: </disk>
Apr 11 17:09:38 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232978.9714177, cfbf4deb-df22-4546-b215-61afb77efcc6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:09:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully detached device vdb from instance cfbf4deb-df22-4546-b215-61afb77efcc6 from the live domain config.
Apr 11 17:09:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAoHhzjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e07ff1-af59-4b65-9177-587460b228ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:39 user nova-compute[71063]: No targets found.
Apr 11 17:09:39 user nova-compute[71063]: iSNS:
Apr 11 17:09:39 user nova-compute[71063]: No targets found.
Apr 11 17:09:39 user nova-compute[71063]: STATIC:
Apr 11 17:09:39 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:39 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:39 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:39 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:39 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:39 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:39 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139
Apr 11 17:09:39 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:39 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:39 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:39 user nova-compute[71063]: No targets found.
Apr 11 17:09:39 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:39 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:39 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37e990-a2d8-45f0-a45c-6dc4750bcdf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b90169-b87a-4d7d-b12b-47c321ee78f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 (non-flash)
Apr 11 17:09:39 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8063b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9950b64-3317-4e2d-b4a3-0372bab0da35]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca57a1-a562-4bec-922a-2ad8e7d2f724]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f48ed4-bd97-472d-a252-736901eee8e1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd0049c-92f1-4c5a-8a04-0b923abe8e70]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0724b597-edd4-4c5e-9e79-e3cdaf99a1bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02f64cc-879e-4043-8526-514a345dbd41]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260]
Apr 11 17:09:39 user nova-compute[71063]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:39 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[92097db4-5bba-47bc-a1dd-e0561e449b59]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== disconnect_volume: return (298ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.621s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:40 user nova-compute[71063]: INFO nova.compute.manager [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Terminating instance
Apr 11 17:09:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-unplugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] No waiting events found dispatching network-vif-unplugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-unplugged-65b16011-5edc-4a36-9493-4ad587afbc19 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:09:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Instance destroyed successfully.
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.objects.instance [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'resources' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-626401967',display_name='tempest-VolumesSnapshotTestJSON-instance-626401967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-626401967',id=17,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-xxko6749',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:07:43Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=cfbf4deb-df22-4546-b215-61afb77efcc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "65b16011-5edc-4a36-9493-4ad587afbc19", "address": "fa:16:3e:38:f2:d7", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65b16011-5e", "ovs_interfaceid": "65b16011-5edc-4a36-9493-4ad587afbc19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_vif [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65b16011-5e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:41 user nova-compute[71063]: INFO os_vif [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:f2:d7,bridge_name='br-int',has_traffic_filtering=True,id=65b16011-5edc-4a36-9493-4ad587afbc19,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65b16011-5e')
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAoHhzjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:41 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dfea4f-66a3-4815-9eda-3924c4f60da3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:41 user nova-compute[71063]: No targets found.
Apr 11 17:09:41 user nova-compute[71063]: iSNS:
Apr 11 17:09:41 user nova-compute[71063]: No targets found.
Apr 11 17:09:41 user nova-compute[71063]: STATIC:
Apr 11 17:09:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:41 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:41 user nova-compute[71063]: No targets found.
Apr 11 17:09:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:41 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:41 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cf1c524-aa18-4ad4-8b51-04ecc1def139', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ad3bb5-fc62-4c88-8998-d792a757926c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cdcdfa-6abc-4b6c-ab77-760c1a1e2226]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:41 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:41 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8045cee0>, {}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Disconnecting from: [] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== disconnect_volume: return (74ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Deleting instance files /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6_del
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Deletion of /opt/stack/data/nova/instances/cfbf4deb-df22-4546-b215-61afb77efcc6_del complete
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.compute.manager [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Took 0.48 seconds to deallocate network for instance.
Apr 11 17:09:41 user nova-compute[71063]: WARNING nova.volume.cinder [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Attachment c93813ab-3cf1-45d9-bb14-b64650c06eee does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c93813ab-3cf1-45d9-bb14-b64650c06eee. (HTTP 404) (Request-ID: req-8b9cc444-9603-40db-aa69-d1fa5890b0bb)
Apr 11 17:09:41 user nova-compute[71063]: INFO nova.compute.manager [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Took 0.03 seconds to detach 1 volumes for instance.
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:42 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Deleted allocations for instance cfbf4deb-df22-4546-b215-61afb77efcc6
Apr 11 17:09:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Acquiring lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Lock "cfbf4deb-df22-4546-b215-61afb77efcc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] No waiting events found dispatching network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:42 user nova-compute[71063]: WARNING nova.compute.manager [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received unexpected event network-vif-plugged-65b16011-5edc-4a36-9493-4ad587afbc19 for instance with vm_state deleted and task_state None.
Apr 11 17:09:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Received event network-vif-deleted-65b16011-5edc-4a36-9493-4ad587afbc19 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:43 user nova-compute[71063]: INFO nova.compute.manager [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Unrescuing
Apr 11 17:09:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG nova.objects.instance [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:44 user nova-compute[71063]: WARNING nova.compute.manager [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance destroyed successfully.
Apr 11 17:09:44 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232969.407727, dba29188-c963-44d4-95fa-09bffbcb8dca => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:44 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Stopped (Lifecycle Event)
Apr 11 17:09:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3fa46f0d-e57a-477d-bbf0-c7841f46767b None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:46 user nova-compute[71063]: WARNING nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:46 user nova-compute[71063]: WARNING nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:46 user nova-compute[71063]: WARNING nova.compute.manager [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 25935a69-292b-4d55-932c-f4893838998c due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232987.6768682, 25935a69-292b-4d55-932c-f4893838998c => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:47 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Resumed (Lifecycle Event)
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:47 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232987.6784089, 25935a69-292b-4d55-932c-f4893838998c => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:47 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Started (Lifecycle Event)
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:53 user nova-compute[71063]: INFO nova.compute.manager [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Unrescuing
Apr 11 17:09:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:09:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:09:53 user nova-compute[71063]: DEBUG nova.network.neutron [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:09:54 user nova-compute[71063]: DEBUG nova.network.neutron [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:09:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:09:54 user nova-compute[71063]: DEBUG nova.objects.instance [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'flavor' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:55 user nova-compute[71063]: WARNING nova.compute.manager [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance destroyed successfully.
Apr 11 17:09:55 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681232980.8894958, cfbf4deb-df22-4546-b215-61afb77efcc6 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:55 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] VM Stopped (Lifecycle Event)
Apr 11 17:09:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a1433b40-6b21-465d-bf65-105e6d5123ff None None] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:56 user nova-compute[71063]: INFO nova.compute.manager [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Detaching volume 24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:57 user nova-compute[71063]: INFO nova.virt.block_device [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attempting to driver detach volume 24daff67-0055-44fd-8be9-acf4b3f77ff5 from mountpoint /dev/vdb
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Attempting to detach device vdb from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:57 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:57 user nova-compute[71063]:   <source dev="/dev/sde"/>
Apr 11 17:09:57 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:57 user nova-compute[71063]:   <serial>24daff67-0055-44fd-8be9-acf4b3f77ff5</serial>
Apr 11 17:09:57 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:09:57 user nova-compute[71063]: </disk>
Apr 11 17:09:57 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:57 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully detached device vdb from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the persistent domain config.
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:09:57 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:09:57 user nova-compute[71063]:   <source dev="/dev/sde"/>
Apr 11 17:09:57 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:09:57 user nova-compute[71063]:   <serial>24daff67-0055-44fd-8be9-acf4b3f77ff5</serial>
Apr 11 17:09:57 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:09:57 user nova-compute[71063]: </disk>
Apr 11 17:09:57 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:57 user nova-compute[71063]: WARNING nova.compute.manager [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681232997.571515, 1fc7677c-cbd9-48e7-be62-2210074bc87a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:09:57 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully detached device vdb from instance 1fc7677c-cbd9-48e7-be62-2210074bc87a from the live domain config.
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fRKyqiNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:09:57 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34710a7-516f-4ef8-a2a6-5ff815800059]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:09:57 user nova-compute[71063]: No targets found.
Apr 11 17:09:57 user nova-compute[71063]: iSNS:
Apr 11 17:09:57 user nova-compute[71063]: No targets found.
Apr 11 17:09:57 user nova-compute[71063]: STATIC:
Apr 11 17:09:57 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:09:57 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:57 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:57 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5
Apr 11 17:09:57 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:09:57 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:09:57 user nova-compute[71063]: FIRMWARE:
Apr 11 17:09:57 user nova-compute[71063]: No targets found.
Apr 11 17:09:57 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:09:57 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:09:57 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d592fd37-0b1b-48c0-94a2-182cbb8a8dd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876e575-8166-49f1-bff2-1ea8e4d86561]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:57 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:57 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:09:57 user nova-compute[71063]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 (non-flash)
Apr 11 17:09:57 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec172d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5'): ({'sde'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sde {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461aa02-73db-4aba-a9fd-d7f77e5c72a7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e95b87-0e48-4695-a010-6fca49f5ec46]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sde {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e466d-ed2b-42d1-b4d1-1d86346e3424]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[56888a0d-6c52-4f04-b126-e60bc5a2cb9c]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3dca9-1202-4e57-a76b-01653b015579]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b16324-1673-4e0e-b07c-481bc0ea82b7]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260]
Apr 11 17:09:57 user nova-compute[71063]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5, portal: 172.16.0.220,3260] successful.
Apr 11 17:09:57 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24daff67-0055-44fd-8be9-acf4b3f77ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[05071cfa-8757-4e26-978e-93c5b3cd0d59]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (286ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:09:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:09:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:09:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'flavor' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:09:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.701s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:59 user nova-compute[71063]: WARNING nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:09:59 user nova-compute[71063]: WARNING nova.compute.manager [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 1289fdf8-8842-4e16-80dc-a287bc08fb02 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232999.7291093, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:59 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Resumed (Lifecycle Event)
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:09:59 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681232999.7304192, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:09:59 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Started (Lifecycle Event)
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:09:59 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:10:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:10:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:10:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:01 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:01 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:10:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:10:10 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:10 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7405MB free_disk=26.226844787597656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9339e177-6264-4942-9dd1-372681209790 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 43b7642b-356d-4122-b006-fe7681192995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 351fca73-83de-49b4-91d8-72e3cf45a59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing instance network info cache due to event network-changed-24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Acquiring lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Acquired lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Refreshing network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:10 user nova-compute[71063]: INFO nova.compute.manager [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Terminating instance
Apr 11 17:10:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-unplugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] No waiting events found dispatching network-vif-unplugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-unplugged-24930491-6f3c-445d-ad6b-c4d37775783a for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] Instance destroyed successfully.
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'resources' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1895242332',display_name='tempest-TestStampPattern-server-1895242332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1895242332',id=16,image_ref='17bbf027-fa96-46ed-80c2-65e5f74cbbd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-r0ojd597',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9339e177-6264-4942-9dd1-372681209790',image_min_disk='1',image_min_ram='0',image_owner_id='ec4085a617084465ae810ff06498f992',image_owner_project_name='tempest-TestStampPattern-1846780226',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1846780226-project-member',image_user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:07:32Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=43b7642b-356d-4122-b006-fe7681192995,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG os_vif [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24930491-6f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: INFO os_vif [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:6a:49,bridge_name='br-int',has_traffic_filtering=True,id=24930491-6f3c-445d-ad6b-c4d37775783a,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24930491-6f')
Apr 11 17:10:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Deleting instance files /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995_del
Apr 11 17:10:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Deletion of /opt/stack/data/nova/instances/43b7642b-356d-4122-b006-fe7681192995_del complete
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: INFO nova.compute.manager [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:10:11 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] Took 0.66 seconds to deallocate network for instance.
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updated VIF entry in instance network info cache for port 24930491-6f3c-445d-ad6b-c4d37775783a. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [{"id": "24930491-6f3c-445d-ad6b-c4d37775783a", "address": "fa:16:3e:72:6a:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24930491-6f", "ovs_interfaceid": "24930491-6f3c-445d-ad6b-c4d37775783a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Releasing lock "refresh_cache-43b7642b-356d-4122-b006-fe7681192995" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-deleted-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:12 user nova-compute[71063]: INFO nova.compute.manager [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Neutron deleted interface 24930491-6f3c-445d-ad6b-c4d37775783a; detaching it from the instance and deleting it from the info cache
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Detach interface failed, port_id=24930491-6f3c-445d-ad6b-c4d37775783a, reason: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:10:12 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Deleted allocations for instance 43b7642b-356d-4122-b006-fe7681192995
Apr 11 17:10:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "43b7642b-356d-4122-b006-fe7681192995" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Acquiring lock "43b7642b-356d-4122-b006-fe7681192995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Lock "43b7642b-356d-4122-b006-fe7681192995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] No waiting events found dispatching network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:13 user nova-compute[71063]: WARNING nova.compute.manager [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] [instance: 43b7642b-356d-4122-b006-fe7681192995] Received unexpected event network-vif-plugged-24930491-6f3c-445d-ad6b-c4d37775783a for instance with vm_state deleted and task_state None.
Apr 11 17:10:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:18 user nova-compute[71063]: INFO nova.compute.manager [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Terminating instance
Apr 11 17:10:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-unplugged-34535545-332f-47ea-b110-74b5f957388e for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:10:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Instance destroyed successfully.
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.objects.instance [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'resources' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-296076626',display_name='tempest-ServerStableDeviceRescueTest-server-296076626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-296076626',id=2,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL7i/fp+DnNA0UzB89OuJAWEkDI3RLIMqdCUH+lLMjesQHNn0HLcj03mslu5ZdYDA0lbw8n78DIaEgXcMzFJM3/kIURu2fRqfoahFiI9aLfMiPTgBrcusJmx/nC+OKLjg==',key_name='tempest-keypair-1584212675',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b803e7cf929440298b14cd3177c96e8',ramdisk_id='',reservation_id='r-15wgi8q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1699560884',owner_user_name='tempest-ServerStableDeviceRescueTest-1699560884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6126b468bd2414d831b105a3429ddd1',uuid=17f03f63-a491-4fd4-a282-a4e9b5b6aa2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converting VIF {"id": "34535545-332f-47ea-b110-74b5f957388e", "address": "fa:16:3e:70:63:7b", "network": {"id": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-503765963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b803e7cf929440298b14cd3177c96e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34535545-33", "ovs_interfaceid": "34535545-332f-47ea-b110-74b5f957388e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG os_vif [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34535545-33, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:19 user nova-compute[71063]: INFO os_vif [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:63:7b,bridge_name='br-int',has_traffic_filtering=True,id=34535545-332f-47ea-b110-74b5f957388e,network=Network(fde90b2e-cb9a-41ba-a2ea-7c54065f557e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34535545-33')
Apr 11 17:10:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Deleting instance files /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e_del
Apr 11 17:10:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Deletion of /opt/stack/data/nova/instances/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e_del complete
Apr 11 17:10:19 user nova-compute[71063]: INFO nova.compute.manager [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 17:10:19 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:10:19 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:20 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Took 0.92 seconds to deallocate network for instance.
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-deleted-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:20 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Deleted allocations for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e
Apr 11 17:10:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Acquiring lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Lock "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] No waiting events found dispatching network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:20 user nova-compute[71063]: WARNING nova.compute.manager [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Received unexpected event network-vif-plugged-34535545-332f-47ea-b110-74b5f957388e for instance with vm_state deleted and task_state None.
Apr 11 17:10:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233011.520309, 43b7642b-356d-4122-b006-fe7681192995 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 43b7642b-356d-4122-b006-fe7681192995] VM Stopped (Lifecycle Event)
Apr 11 17:10:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e46a1100-eb45-4f12-8ec0-52c77f9e03b7 None None] [instance: 43b7642b-356d-4122-b006-fe7681192995] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:10:29 user nova-compute[71063]: INFO nova.compute.claims [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Claim successful on node user
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:10:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.policy [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:10:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Creating image(s)
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk 1073741824" returned: 0 in 0.056s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Successfully created port: d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Cannot resize image /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'migration_context' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Ensure instance console log exists: /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Successfully updated port: d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-changed-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing instance network info cache due to event network-changed-d5605470-2058-46dd-bc30-a8f0ba8c82db. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Instance network_info: |[{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.neutron [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing network info cache for port d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Start _get_guest_xml network_info=[{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:10:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'pci_devices' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:10:32 user nova-compute[71063]:   <uuid>9efebdaa-288e-42f5-af7d-ca64963be57a</uuid>
Apr 11 17:10:32 user nova-compute[71063]:   <name>instance-00000016</name>
Apr 11 17:10:32 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:10:32 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:10:32 user nova-compute[71063]:   <metadata>
Apr 11 17:10:32 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:10:32 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:10:32</nova:creationTime>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:10:32 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:10:32 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:owner>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:10:32 user nova-compute[71063]:       </nova:owner>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:10:32 user nova-compute[71063]:       <nova:ports>
Apr 11 17:10:32 user nova-compute[71063]:         <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:10:32 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:10:32 user nova-compute[71063]:         </nova:port>
Apr 11 17:10:32 user nova-compute[71063]:       </nova:ports>
Apr 11 17:10:32 user nova-compute[71063]:     </nova:instance>
Apr 11 17:10:32 user nova-compute[71063]:   </metadata>
Apr 11 17:10:32 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:10:32 user nova-compute[71063]:     <system>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="serial">9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="uuid">9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:10:32 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:10:32 user nova-compute[71063]:     </system>
Apr 11 17:10:32 user nova-compute[71063]:   </sysinfo>
Apr 11 17:10:32 user nova-compute[71063]:   <os>
Apr 11 17:10:32 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:10:32 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:10:32 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:10:32 user nova-compute[71063]:   </os>
Apr 11 17:10:32 user nova-compute[71063]:   <features>
Apr 11 17:10:32 user nova-compute[71063]:     <acpi/>
Apr 11 17:10:32 user nova-compute[71063]:     <apic/>
Apr 11 17:10:32 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:10:32 user nova-compute[71063]:   </features>
Apr 11 17:10:32 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:10:32 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:10:32 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:10:32 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:10:32 user nova-compute[71063]:   </clock>
Apr 11 17:10:32 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:10:32 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:10:32 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:10:32 user nova-compute[71063]:   </cpu>
Apr 11 17:10:32 user nova-compute[71063]:   <devices>
Apr 11 17:10:32 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:10:32 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:10:32 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk"/>
Apr 11 17:10:32 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:10:32 user nova-compute[71063]:     </disk>
Apr 11 17:10:32 user nova-compute[71063]:     <disk type="file" device="cdrom">
Apr 11 17:10:32 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 17:10:32 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config"/>
Apr 11 17:10:32 user nova-compute[71063]:       <target dev="hda" bus="ide"/>
Apr 11 17:10:32 user nova-compute[71063]:     </disk>
Apr 11 17:10:32 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:10:32 user nova-compute[71063]:       <mac address="fa:16:3e:6a:66:a9"/>
Apr 11 17:10:32 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:32 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:10:32 user nova-compute[71063]:       <target dev="tapd5605470-20"/>
Apr 11 17:10:32 user nova-compute[71063]:     </interface>
Apr 11 17:10:32 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:10:32 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log" append="off"/>
Apr 11 17:10:32 user nova-compute[71063]:     </serial>
Apr 11 17:10:32 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:10:32 user nova-compute[71063]:     <video>
Apr 11 17:10:32 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:32 user nova-compute[71063]:     </video>
Apr 11 17:10:32 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:10:32 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:10:32 user nova-compute[71063]:     </rng>
Apr 11 17:10:32 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:10:32 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:10:32 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:10:32 user nova-compute[71063]:     </memballoon>
Apr 11 17:10:32 user nova-compute[71063]:   </devices>
Apr 11 17:10:32 user nova-compute[71063]: </domain>
Apr 11 17:10:32 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG os_vif [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5605470-20, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5605470-20, col_values=(('external_ids', {'iface-id': 'd5605470-2058-46dd-bc30-a8f0ba8c82db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:66:a9', 'vm-uuid': '9efebdaa-288e-42f5-af7d-ca64963be57a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:33 user nova-compute[71063]: INFO os_vif [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20')
Apr 11 17:10:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name hda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No VIF found with MAC fa:16:3e:6a:66:a9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:10:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Using config drive
Apr 11 17:10:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Creating config drive at /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config
Apr 11 17:10:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphwwzrme_ {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphwwzrme_" returned: 0 in 0.054s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG nova.network.neutron [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updated VIF entry in instance network info cache for port d5605470-2058-46dd-bc30-a8f0ba8c82db. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG nova.network.neutron [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233019.266987, 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:34 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] VM Stopped (Lifecycle Event)
Apr 11 17:10:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-653d5227-4af6-4eb7-88e9-a1947a5e792c None None] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:34 user nova-compute[71063]: WARNING nova.compute.manager [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state building and task_state spawning.
Apr 11 17:10:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:10:35 user nova-compute[71063]: INFO nova.compute.claims [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Claim successful on node user
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:10:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.policy [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:10:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Creating image(s)
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "/opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "/opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "/opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:35 user nova-compute[71063]: INFO nova.compute.manager [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Terminating instance
Apr 11 17:10:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk 1073741824" returned: 0 in 0.049s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-unplugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] No waiting events found dispatching network-vif-unplugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-unplugged-443112af-6269-4e46-b9d5-ee7645b57a4d for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Cannot resize image /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'migration_context' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Ensure instance console log exists: /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Instance destroyed successfully.
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lazy-loading 'resources' on Instance uuid c689a3c0-b429-49fd-9b20-eb73353ac0b1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:08:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753808701',display_name='tempest-VolumesActionsTest-instance-753808701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753808701',id=20,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:08:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b39994062d984774a3755b822f9a2fa7',ramdisk_id='',reservation_id='r-7pkpo3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-316903536',owner_user_name='tempest-VolumesActionsTest-316903536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:08:48Z,user_data=None,user_id='f637a2235ae447dc83dc4b2eb5554bff',uuid=c689a3c0-b429-49fd-9b20-eb73353ac0b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converting VIF {"id": "443112af-6269-4e46-b9d5-ee7645b57a4d", "address": "fa:16:3e:36:70:87", "network": {"id": "5b226129-4389-4397-b183-5260af7d71bc", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1592320206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b39994062d984774a3755b822f9a2fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443112af-62", "ovs_interfaceid": "443112af-6269-4e46-b9d5-ee7645b57a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG os_vif [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap443112af-62, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:36 user nova-compute[71063]: INFO os_vif [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:70:87,bridge_name='br-int',has_traffic_filtering=True,id=443112af-6269-4e46-b9d5-ee7645b57a4d,network=Network(5b226129-4389-4397-b183-5260af7d71bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443112af-62')
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Deleting instance files /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1_del
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Deletion of /opt/stack/data/nova/instances/c689a3c0-b429-49fd-9b20-eb73353ac0b1_del complete
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 11 17:10:36 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Successfully created port: 3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233036.7962244, 9efebdaa-288e-42f5-af7d-ca64963be57a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] VM Resumed (Lifecycle Event)
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Instance spawned successfully.
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233036.799657, 9efebdaa-288e-42f5-af7d-ca64963be57a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] VM Started (Lifecycle Event)
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:10:36 user nova-compute[71063]: INFO nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Took 6.18 seconds to spawn the instance on the hypervisor.
Apr 11 17:10:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:37 user nova-compute[71063]: INFO nova.compute.manager [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Took 7.15 seconds to build instance.
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.257s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:37 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Took 0.66 seconds to deallocate network for instance.
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:37 user nova-compute[71063]: WARNING nova.compute.manager [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state active and task_state None.
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-deleted-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Successfully updated port: 3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquired lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:37 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Deleted allocations for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Updating instance_info_cache with network_info: [{"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Releasing lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Instance network_info: |[{"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Start _get_guest_xml network_info=[{"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:10:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-802621587',display_name='tempest-VolumesSnapshotTestJSON-instance-802621587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-802621587',id=23,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-r31jnoj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:10:36Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=5132062e-f602-4568-83ed-bc6fa2890300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'pci_devices' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:10:37 user nova-compute[71063]:   <uuid>5132062e-f602-4568-83ed-bc6fa2890300</uuid>
Apr 11 17:10:37 user nova-compute[71063]:   <name>instance-00000017</name>
Apr 11 17:10:37 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:10:37 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:10:37 user nova-compute[71063]:   <metadata>
Apr 11 17:10:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:10:37 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-802621587</nova:name>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:10:37</nova:creationTime>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:10:37 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:10:37 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:owner>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:user uuid="2878fecd141a4c0f97ead618b9cfdcbf">tempest-VolumesSnapshotTestJSON-1455403265-project-member</nova:user>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:project uuid="3ab7d4c5adc544ef9ed9f774e1e144cc">tempest-VolumesSnapshotTestJSON-1455403265</nova:project>
Apr 11 17:10:37 user nova-compute[71063]:       </nova:owner>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:10:37 user nova-compute[71063]:       <nova:ports>
Apr 11 17:10:37 user nova-compute[71063]:         <nova:port uuid="3cb911aa-7791-4ad0-af48-0e70fcd29e68">
Apr 11 17:10:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:10:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:10:37 user nova-compute[71063]:       </nova:ports>
Apr 11 17:10:37 user nova-compute[71063]:     </nova:instance>
Apr 11 17:10:37 user nova-compute[71063]:   </metadata>
Apr 11 17:10:37 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:10:37 user nova-compute[71063]:     <system>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="serial">5132062e-f602-4568-83ed-bc6fa2890300</entry>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="uuid">5132062e-f602-4568-83ed-bc6fa2890300</entry>
Apr 11 17:10:37 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:10:37 user nova-compute[71063]:     </system>
Apr 11 17:10:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:10:37 user nova-compute[71063]:   <os>
Apr 11 17:10:37 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:10:37 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:10:37 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:10:37 user nova-compute[71063]:   </os>
Apr 11 17:10:37 user nova-compute[71063]:   <features>
Apr 11 17:10:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:10:37 user nova-compute[71063]:     <apic/>
Apr 11 17:10:37 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:10:37 user nova-compute[71063]:   </features>
Apr 11 17:10:37 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:10:37 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:10:37 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:10:37 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:10:37 user nova-compute[71063]:   </clock>
Apr 11 17:10:37 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:10:37 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:10:37 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:10:37 user nova-compute[71063]:   </cpu>
Apr 11 17:10:37 user nova-compute[71063]:   <devices>
Apr 11 17:10:37 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:10:37 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:10:37 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk"/>
Apr 11 17:10:37 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:10:37 user nova-compute[71063]:     </disk>
Apr 11 17:10:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:10:37 user nova-compute[71063]:       <mac address="fa:16:3e:24:ac:4c"/>
Apr 11 17:10:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:10:37 user nova-compute[71063]:       <target dev="tap3cb911aa-77"/>
Apr 11 17:10:37 user nova-compute[71063]:     </interface>
Apr 11 17:10:37 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:10:37 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/console.log" append="off"/>
Apr 11 17:10:37 user nova-compute[71063]:     </serial>
Apr 11 17:10:37 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:10:37 user nova-compute[71063]:     <video>
Apr 11 17:10:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:37 user nova-compute[71063]:     </video>
Apr 11 17:10:37 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:10:37 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:10:37 user nova-compute[71063]:     </rng>
Apr 11 17:10:37 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:10:37 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:10:37 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:10:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:10:37 user nova-compute[71063]:   </devices>
Apr 11 17:10:37 user nova-compute[71063]: </domain>
Apr 11 17:10:37 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-802621587',display_name='tempest-VolumesSnapshotTestJSON-instance-802621587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-802621587',id=23,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-r31jnoj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:10:36Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=5132062e-f602-4568-83ed-bc6fa2890300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG os_vif [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cb911aa-77, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3cb911aa-77, col_values=(('external_ids', {'iface-id': '3cb911aa-7791-4ad0-af48-0e70fcd29e68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:ac:4c', 'vm-uuid': '5132062e-f602-4568-83ed-bc6fa2890300'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:37 user nova-compute[71063]: INFO os_vif [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77')
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No VIF found with MAC fa:16:3e:24:ac:4c, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Acquiring lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Lock "c689a3c0-b429-49fd-9b20-eb73353ac0b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] No waiting events found dispatching network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:38 user nova-compute[71063]: WARNING nova.compute.manager [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Received unexpected event network-vif-plugged-443112af-6269-4e46-b9d5-ee7645b57a4d for instance with vm_state deleted and task_state None.
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-changed-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Refreshing instance network info cache due to event network-changed-3cb911aa-7791-4ad0-af48-0e70fcd29e68. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Acquiring lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Acquired lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Refreshing network info cache for port 3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Updated VIF entry in instance network info cache for port 3cb911aa-7791-4ad0-af48-0e70fcd29e68. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Updating instance_info_cache with network_info: [{"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Releasing lock "refresh_cache-5132062e-f602-4568-83ed-bc6fa2890300" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] No waiting events found dispatching network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:39 user nova-compute[71063]: WARNING nova.compute.manager [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received unexpected event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance with vm_state building and task_state spawning.
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233041.5059934, 5132062e-f602-4568-83ed-bc6fa2890300 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] VM Resumed (Lifecycle Event)
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Instance spawned successfully.
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233041.507019, 5132062e-f602-4568-83ed-bc6fa2890300 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] VM Started (Lifecycle Event)
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Took 5.92 seconds to spawn the instance on the hypervisor.
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] No waiting events found dispatching network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:41 user nova-compute[71063]: WARNING nova.compute.manager [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received unexpected event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance with vm_state building and task_state spawning.
Apr 11 17:10:41 user nova-compute[71063]: INFO nova.compute.manager [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Took 6.76 seconds to build instance.
Apr 11 17:10:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.859s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:51 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233036.4153097, c689a3c0-b429-49fd-9b20-eb73353ac0b1 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:10:51 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] VM Stopped (Lifecycle Event)
Apr 11 17:10:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a664392c-af56-4dc7-8707-8385887d7d49 None None] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:10:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquired lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.network.neutron [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'info_cache' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.network.neutron [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Releasing lock "refresh_cache-d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:10:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance destroyed successfully.
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'resources' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG os_vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4b45a7-1e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:55 user nova-compute[71063]: INFO os_vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start _get_guest_xml network_info=[{"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'numa_topology' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:10:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'vcpu_model' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'pci_devices' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:10:56 user nova-compute[71063]:   <uuid>d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</uuid>
Apr 11 17:10:56 user nova-compute[71063]:   <name>instance-00000007</name>
Apr 11 17:10:56 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:10:56 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:10:56 user nova-compute[71063]:   <metadata>
Apr 11 17:10:56 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:10:56 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeTestJSON-server-1659221805</nova:name>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:10:55</nova:creationTime>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:10:56 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:10:56 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:owner>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:user uuid="ac0109eab2dc45fe824a03e2d09fa022">tempest-AttachVolumeTestJSON-1071232138-project-member</nova:user>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:project uuid="3c902eb30be24cc6bd26c0ab7036d037">tempest-AttachVolumeTestJSON-1071232138</nova:project>
Apr 11 17:10:56 user nova-compute[71063]:       </nova:owner>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:10:56 user nova-compute[71063]:       <nova:ports>
Apr 11 17:10:56 user nova-compute[71063]:         <nova:port uuid="8b4b45a7-1e14-4c93-a6a9-fe814512cef2">
Apr 11 17:10:56 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:10:56 user nova-compute[71063]:         </nova:port>
Apr 11 17:10:56 user nova-compute[71063]:       </nova:ports>
Apr 11 17:10:56 user nova-compute[71063]:     </nova:instance>
Apr 11 17:10:56 user nova-compute[71063]:   </metadata>
Apr 11 17:10:56 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:10:56 user nova-compute[71063]:     <system>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="serial">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="uuid">d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32</entry>
Apr 11 17:10:56 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:10:56 user nova-compute[71063]:     </system>
Apr 11 17:10:56 user nova-compute[71063]:   </sysinfo>
Apr 11 17:10:56 user nova-compute[71063]:   <os>
Apr 11 17:10:56 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:10:56 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:10:56 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:10:56 user nova-compute[71063]:   </os>
Apr 11 17:10:56 user nova-compute[71063]:   <features>
Apr 11 17:10:56 user nova-compute[71063]:     <acpi/>
Apr 11 17:10:56 user nova-compute[71063]:     <apic/>
Apr 11 17:10:56 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:10:56 user nova-compute[71063]:   </features>
Apr 11 17:10:56 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:10:56 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:10:56 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:10:56 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:10:56 user nova-compute[71063]:   </clock>
Apr 11 17:10:56 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:10:56 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:10:56 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:10:56 user nova-compute[71063]:   </cpu>
Apr 11 17:10:56 user nova-compute[71063]:   <devices>
Apr 11 17:10:56 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:10:56 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:10:56 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk"/>
Apr 11 17:10:56 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:10:56 user nova-compute[71063]:     </disk>
Apr 11 17:10:56 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:10:56 user nova-compute[71063]:       <mac address="fa:16:3e:42:9e:29"/>
Apr 11 17:10:56 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:56 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:10:56 user nova-compute[71063]:       <target dev="tap8b4b45a7-1e"/>
Apr 11 17:10:56 user nova-compute[71063]:     </interface>
Apr 11 17:10:56 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:10:56 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/console.log" append="off"/>
Apr 11 17:10:56 user nova-compute[71063]:     </serial>
Apr 11 17:10:56 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:10:56 user nova-compute[71063]:     <video>
Apr 11 17:10:56 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:10:56 user nova-compute[71063]:     </video>
Apr 11 17:10:56 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:10:56 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:10:56 user nova-compute[71063]:     </rng>
Apr 11 17:10:56 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:10:56 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:10:56 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:10:56 user nova-compute[71063]:     </memballoon>
Apr 11 17:10:56 user nova-compute[71063]:   </devices>
Apr 11 17:10:56 user nova-compute[71063]: </domain>
Apr 11 17:10:56 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'trusted_certs' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Cannot resize image /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'migration_context' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG os_vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b4b45a7-1e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b4b45a7-1e, col_values=(('external_ids', {'iface-id': '8b4b45a7-1e14-4c93-a6a9-fe814512cef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:9e:29', 'vm-uuid': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:10:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:56 user nova-compute[71063]: INFO os_vif [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:10:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:10:58 user nova-compute[71063]: WARNING nova.compute.manager [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state powering-on.
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:10:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233060.166017, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Resumed (Lifecycle Event)
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:11:00 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance rebooted successfully.
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233060.1673872, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Started (Lifecycle Event)
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:00 user nova-compute[71063]: WARNING nova.compute.manager [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state stopped and task_state powering-on.
Apr 11 17:11:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing instance network info cache due to event network-changed-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Acquiring lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Acquired lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Refreshing network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "9339e177-6264-4942-9dd1-372681209790-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:04 user nova-compute[71063]: INFO nova.compute.manager [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Terminating instance
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-unplugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Acquiring lock "9339e177-6264-4942-9dd1-372681209790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] No waiting events found dispatching network-vif-unplugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-unplugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updated VIF entry in instance network info cache for port dbe2ecc7-b16b-4a77-8bf7-650a08d999ce. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating instance_info_cache with network_info: [{"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Releasing lock "refresh_cache-9339e177-6264-4942-9dd1-372681209790" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Skipping network cache update for instance because it is being deleted. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9339e177-6264-4942-9dd1-372681209790] Instance destroyed successfully.
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'resources' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2117639307',display_name='tempest-TestStampPattern-server-2117639307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-2117639307',id=13,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA==',key_name='tempest-TestStampPattern-1509466846',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec4085a617084465ae810ff06498f992',ramdisk_id='',reservation_id='r-uixjcn3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1846780226',owner_user_name='tempest-TestStampPattern-1846780226-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:07:16Z,user_data=None,user_id='1f7d3b94cc6b4a7d95489d7d4cf6e297',uuid=9339e177-6264-4942-9dd1-372681209790,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converting VIF {"id": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "address": "fa:16:3e:b3:d9:49", "network": {"id": "bdb09d43-70cb-4856-948c-4e13c107fac8", "bridge": "br-int", "label": "tempest-TestStampPattern-1701568162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec4085a617084465ae810ff06498f992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbe2ecc7-b1", "ovs_interfaceid": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG os_vif [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbe2ecc7-b1, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:11:05 user nova-compute[71063]: INFO os_vif [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d9:49,bridge_name='br-int',has_traffic_filtering=True,id=dbe2ecc7-b16b-4a77-8bf7-650a08d999ce,network=Network(bdb09d43-70cb-4856-948c-4e13c107fac8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbe2ecc7-b1')
Apr 11 17:11:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Deleting instance files /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790_del
Apr 11 17:11:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Deletion of /opt/stack/data/nova/instances/9339e177-6264-4942-9dd1-372681209790_del complete
Apr 11 17:11:05 user nova-compute[71063]: INFO nova.compute.manager [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 9339e177-6264-4942-9dd1-372681209790] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9339e177-6264-4942-9dd1-372681209790] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:11:05 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9339e177-6264-4942-9dd1-372681209790] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:06 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9339e177-6264-4942-9dd1-372681209790] Took 0.55 seconds to deallocate network for instance.
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.162s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:11:06 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Deleted allocations for instance 9339e177-6264-4942-9dd1-372681209790
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "9339e177-6264-4942-9dd1-372681209790" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-deleted-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Acquiring lock "9339e177-6264-4942-9dd1-372681209790-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Lock "9339e177-6264-4942-9dd1-372681209790-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] No waiting events found dispatching network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:06 user nova-compute[71063]: WARNING nova.compute.manager [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] [instance: 9339e177-6264-4942-9dd1-372681209790] Received unexpected event network-vif-plugged-dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance with vm_state deleted and task_state None.
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:06 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:07 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:11:09 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:09 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:09 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=26.37732696533203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 351fca73-83de-49b4-91d8-72e3cf45a59c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9efebdaa-288e-42f5-af7d-ca64963be57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 5132062e-f602-4568-83ed-bc6fa2890300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:11:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:11:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:15 user nova-compute[71063]: INFO nova.compute.manager [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Terminating instance
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-unplugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] No waiting events found dispatching network-vif-unplugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-unplugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:11:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Instance destroyed successfully.
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'resources' on Instance uuid 351fca73-83de-49b4-91d8-72e3cf45a59c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1556364363',display_name='tempest-ServersNegativeTestJSON-server-1556364363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1556364363',id=21,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:09:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-zk0l98nj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:09:33Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=351fca73-83de-49b4-91d8-72e3cf45a59c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "address": "fa:16:3e:2c:22:8b", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe19475b-d2", "ovs_interfaceid": "fe19475b-d2f0-4f2a-814c-dc6650833ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG os_vif [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe19475b-d2, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:11:15 user nova-compute[71063]: INFO os_vif [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:22:8b,bridge_name='br-int',has_traffic_filtering=True,id=fe19475b-d2f0-4f2a-814c-dc6650833ff5,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe19475b-d2')
Apr 11 17:11:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Deleting instance files /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c_del
Apr 11 17:11:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Deletion of /opt/stack/data/nova/instances/351fca73-83de-49b4-91d8-72e3cf45a59c_del complete
Apr 11 17:11:15 user nova-compute[71063]: INFO nova.compute.manager [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 17:11:15 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:11:15 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:16 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Took 0.56 seconds to deallocate network for instance.
Apr 11 17:11:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-deleted-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:16 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Deleted allocations for instance 351fca73-83de-49b4-91d8-72e3cf45a59c
Apr 11 17:11:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Acquiring lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Lock "351fca73-83de-49b4-91d8-72e3cf45a59c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] No waiting events found dispatching network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:17 user nova-compute[71063]: WARNING nova.compute.manager [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Received unexpected event network-vif-plugged-fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance with vm_state deleted and task_state None.
Apr 11 17:11:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:20 user nova-compute[71063]: INFO nova.compute.manager [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Unshelving
Apr 11 17:11:20 user nova-compute[71063]: INFO nova.virt.block_device [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Booting with volume fbbb37a6-c422-4ef3-98c9-e208a1934805 at /dev/vda
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.utils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded5da7b-14a9-460a-9a40-dd2fc8d4c6b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714c963-6553-4764-abdc-fbc4bd298e65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233065.3479102, 9339e177-6264-4942-9dd1-372681209790 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:20 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9339e177-6264-4942-9dd1-372681209790] VM Stopped (Lifecycle Event)
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff83623-8611-451d-a88a-be7846e307e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[74925066-7da3-4c45-8fd2-9428c53bffca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-df40da24-9295-47eb-9c67-b7596317ec52 None None] [instance: 9339e177-6264-4942-9dd1-372681209790] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:11:20 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:11:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c2921-3a61-4f69-a2f5-d3183956db0f]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG os_brick.utils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating existing volume attachment record: aa0d22c1-adc9-4d38-8df5-8407c21dddfb {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:11:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'pci_requests' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'numa_topology' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:11:24 user nova-compute[71063]: INFO nova.compute.claims [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Claim successful on node user
Apr 11 17:11:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:25 user nova-compute[71063]: INFO nova.network.neutron [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating port fe9d8f85-8c07-4fef-ac72-417df1310bd3 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 17:11:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing instance network info cache due to event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:11:26 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Creating image(s)
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Ensure instance console log exists: /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start _get_guest_xml network_info=[{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'aa0d22c1-adc9-4d38-8df5-8407c21dddfb', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dba29188-c963-44d4-95fa-09bffbcb8dca', 'attached_at': '', 'detached_at': '', 'volume_id': 'fbbb37a6-c422-4ef3-98c9-e208a1934805', 'serial': 'fbbb37a6-c422-4ef3-98c9-e208a1934805'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:11:26 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:26 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:11:26 user nova-compute[71063]: DEBUG nova.objects.instance [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'vcpu_model' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:11:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:11:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:11:27 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe6e447-7f49-4ae5-8224-5b64d632abb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:11:27 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[827f4e8f-e2ef-42f8-8c92-ec0b9e71c2b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805] added
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[681078bc-75c9-4757-85c0-dbf05ede0eec]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca49545-f20b-4520-a33b-abab3b1df623]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzvRkVNY {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DzvRkVNY" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[91222459-b9f4-4892-9560-77dd5516eb45]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DzvRkVNY'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b4217c-ce6e-40ca-af5b-88c04d77b795]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1ed8f-b428-4c13-8918-ad7203cadd48]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f9786-7eb2-4b2e-b9aa-28be93c20712]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]
Apr 11 17:11:27 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d435e0-308e-43f0-a5ab-ab4b542b9766]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c48da1-6be7-4d6a-91a4-7851e3ce6567]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ceebfa-8023-4236-8e34-546300852d9e]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:11:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updated VIF entry in instance network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23435393664623563', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435393664623563', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1839642534',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:11:20Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'pci_devices' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:11:28 user nova-compute[71063]:   <uuid>dba29188-c963-44d4-95fa-09bffbcb8dca</uuid>
Apr 11 17:11:28 user nova-compute[71063]:   <name>instance-00000013</name>
Apr 11 17:11:28 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:11:28 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:11:28 user nova-compute[71063]:   <metadata>
Apr 11 17:11:28 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:11:28 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:11:28 user nova-compute[71063]:       <nova:name>tempest-TestShelveInstance-server-263726245</nova:name>
Apr 11 17:11:28 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:11:26</nova:creationTime>
Apr 11 17:11:28 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:11:28 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:11:28 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:11:28 user nova-compute[71063]:       <nova:owner>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:user uuid="ea404079db924f70b4a22278cee452dc">tempest-TestShelveInstance-720963145-project-member</nova:user>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:project uuid="bf2f734d27a049e7b97ba50db0db0b6c">tempest-TestShelveInstance-720963145</nova:project>
Apr 11 17:11:28 user nova-compute[71063]:       </nova:owner>
Apr 11 17:11:28 user nova-compute[71063]:       <nova:ports>
Apr 11 17:11:28 user nova-compute[71063]:         <nova:port uuid="fe9d8f85-8c07-4fef-ac72-417df1310bd3">
Apr 11 17:11:28 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 17:11:28 user nova-compute[71063]:         </nova:port>
Apr 11 17:11:28 user nova-compute[71063]:       </nova:ports>
Apr 11 17:11:28 user nova-compute[71063]:     </nova:instance>
Apr 11 17:11:28 user nova-compute[71063]:   </metadata>
Apr 11 17:11:28 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:11:28 user nova-compute[71063]:     <system>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="serial">dba29188-c963-44d4-95fa-09bffbcb8dca</entry>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="uuid">dba29188-c963-44d4-95fa-09bffbcb8dca</entry>
Apr 11 17:11:28 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:11:28 user nova-compute[71063]:     </system>
Apr 11 17:11:28 user nova-compute[71063]:   </sysinfo>
Apr 11 17:11:28 user nova-compute[71063]:   <os>
Apr 11 17:11:28 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:11:28 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:11:28 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:11:28 user nova-compute[71063]:   </os>
Apr 11 17:11:28 user nova-compute[71063]:   <features>
Apr 11 17:11:28 user nova-compute[71063]:     <acpi/>
Apr 11 17:11:28 user nova-compute[71063]:     <apic/>
Apr 11 17:11:28 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:11:28 user nova-compute[71063]:   </features>
Apr 11 17:11:28 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:11:28 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:11:28 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:11:28 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:11:28 user nova-compute[71063]:   </clock>
Apr 11 17:11:28 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:11:28 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:11:28 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:11:28 user nova-compute[71063]:   </cpu>
Apr 11 17:11:28 user nova-compute[71063]:   <devices>
Apr 11 17:11:28 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:11:28 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:11:28 user nova-compute[71063]:       <source dev="/dev/sdc"/>
Apr 11 17:11:28 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:11:28 user nova-compute[71063]:       <serial>fbbb37a6-c422-4ef3-98c9-e208a1934805</serial>
Apr 11 17:11:28 user nova-compute[71063]:     </disk>
Apr 11 17:11:28 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:11:28 user nova-compute[71063]:       <mac address="fa:16:3e:fd:41:f9"/>
Apr 11 17:11:28 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:28 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:11:28 user nova-compute[71063]:       <target dev="tapfe9d8f85-8c"/>
Apr 11 17:11:28 user nova-compute[71063]:     </interface>
Apr 11 17:11:28 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:11:28 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca/console.log" append="off"/>
Apr 11 17:11:28 user nova-compute[71063]:     </serial>
Apr 11 17:11:28 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:11:28 user nova-compute[71063]:     <video>
Apr 11 17:11:28 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:28 user nova-compute[71063]:     </video>
Apr 11 17:11:28 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:11:28 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:11:28 user nova-compute[71063]:     </rng>
Apr 11 17:11:28 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:11:28 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:11:28 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:11:28 user nova-compute[71063]:     </memballoon>
Apr 11 17:11:28 user nova-compute[71063]:   </devices>
Apr 11 17:11:28 user nova-compute[71063]: </domain>
Apr 11 17:11:28 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1839642534',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:11:20Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG os_vif [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe9d8f85-8c, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe9d8f85-8c, col_values=(('external_ids', {'iface-id': 'fe9d8f85-8c07-4fef-ac72-417df1310bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:41:f9', 'vm-uuid': 'dba29188-c963-44d4-95fa-09bffbcb8dca'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:28 user nova-compute[71063]: INFO os_vif [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c')
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] No VIF found with MAC fa:16:3e:fd:41:f9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:11:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:29 user nova-compute[71063]: WARNING nova.compute.manager [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:11:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:30 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233075.621751, 351fca73-83de-49b4-91d8-72e3cf45a59c => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:30 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] VM Stopped (Lifecycle Event)
Apr 11 17:11:30 user nova-compute[71063]: DEBUG nova.compute.manager [None req-3027d047-71aa-4218-b2dc-38ea854382f9 None None] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233091.9262223, dba29188-c963-44d4-95fa-09bffbcb8dca => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Resumed (Lifecycle Event)
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:11:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance spawned successfully.
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:11:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233091.9296968, dba29188-c963-44d4-95fa-09bffbcb8dca => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Started (Lifecycle Event)
Apr 11 17:11:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:32 user nova-compute[71063]: WARNING nova.compute.manager [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:11:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.868s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:11:38 user nova-compute[71063]: INFO nova.compute.claims [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Claim successful on node user
Apr 11 17:11:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:11:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.policy [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:11:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Creating image(s)
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk 1073741824" returned: 0 in 0.056s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.168s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Cannot resize image /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Ensure instance console log exists: /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Successfully created port: b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Successfully updated port: b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing instance network info cache due to event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance network_info: |[{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start _get_guest_xml network_info=[{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:11:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579308500',display_name='tempest-ServerRescueNegativeTestJSON-server-579308500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579308500',id=24,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGkKTLlyaiNlgTA/a3+wQJKjlfUlqxOhcZof+ak5elUWRWmgYc/CbiNKCyQuPLIMAq91lRafTJCTDR90vug4Xdnzc+pbfBDvuS8gBnQ8lxmDuXBq11y3jCZxiBHnPd13g==',key_name='tempest-keypair-896312461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-5q306noz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3666d19053684843b400aab6ebf29cce',uuid=9e213b9c-23c4-4fe4-bd2f-2443ee3628bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:11:40 user nova-compute[71063]:   <uuid>9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</uuid>
Apr 11 17:11:40 user nova-compute[71063]:   <name>instance-00000018</name>
Apr 11 17:11:40 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:11:40 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:11:40 user nova-compute[71063]:   <metadata>
Apr 11 17:11:40 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:11:40 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-579308500</nova:name>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:11:40</nova:creationTime>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:11:40 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:11:40 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:owner>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:11:40 user nova-compute[71063]:       </nova:owner>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:11:40 user nova-compute[71063]:       <nova:ports>
Apr 11 17:11:40 user nova-compute[71063]:         <nova:port uuid="b9d61f36-ee8c-4487-81e1-28d27592a092">
Apr 11 17:11:40 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:11:40 user nova-compute[71063]:         </nova:port>
Apr 11 17:11:40 user nova-compute[71063]:       </nova:ports>
Apr 11 17:11:40 user nova-compute[71063]:     </nova:instance>
Apr 11 17:11:40 user nova-compute[71063]:   </metadata>
Apr 11 17:11:40 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:11:40 user nova-compute[71063]:     <system>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="serial">9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</entry>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="uuid">9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</entry>
Apr 11 17:11:40 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:11:40 user nova-compute[71063]:     </system>
Apr 11 17:11:40 user nova-compute[71063]:   </sysinfo>
Apr 11 17:11:40 user nova-compute[71063]:   <os>
Apr 11 17:11:40 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:11:40 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:11:40 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:11:40 user nova-compute[71063]:   </os>
Apr 11 17:11:40 user nova-compute[71063]:   <features>
Apr 11 17:11:40 user nova-compute[71063]:     <acpi/>
Apr 11 17:11:40 user nova-compute[71063]:     <apic/>
Apr 11 17:11:40 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:11:40 user nova-compute[71063]:   </features>
Apr 11 17:11:40 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:11:40 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:11:40 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:11:40 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:11:40 user nova-compute[71063]:   </clock>
Apr 11 17:11:40 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:11:40 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:11:40 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:11:40 user nova-compute[71063]:   </cpu>
Apr 11 17:11:40 user nova-compute[71063]:   <devices>
Apr 11 17:11:40 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:11:40 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:11:40 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk"/>
Apr 11 17:11:40 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:11:40 user nova-compute[71063]:     </disk>
Apr 11 17:11:40 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:11:40 user nova-compute[71063]:       <mac address="fa:16:3e:f6:6e:38"/>
Apr 11 17:11:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:40 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:11:40 user nova-compute[71063]:       <target dev="tapb9d61f36-ee"/>
Apr 11 17:11:40 user nova-compute[71063]:     </interface>
Apr 11 17:11:40 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:11:40 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/console.log" append="off"/>
Apr 11 17:11:40 user nova-compute[71063]:     </serial>
Apr 11 17:11:40 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:11:40 user nova-compute[71063]:     <video>
Apr 11 17:11:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:40 user nova-compute[71063]:     </video>
Apr 11 17:11:40 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:11:40 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:11:40 user nova-compute[71063]:     </rng>
Apr 11 17:11:40 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:11:40 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:11:40 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:11:40 user nova-compute[71063]:     </memballoon>
Apr 11 17:11:40 user nova-compute[71063]:   </devices>
Apr 11 17:11:40 user nova-compute[71063]: </domain>
Apr 11 17:11:40 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579308500',display_name='tempest-ServerRescueNegativeTestJSON-server-579308500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579308500',id=24,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGkKTLlyaiNlgTA/a3+wQJKjlfUlqxOhcZof+ak5elUWRWmgYc/CbiNKCyQuPLIMAq91lRafTJCTDR90vug4Xdnzc+pbfBDvuS8gBnQ8lxmDuXBq11y3jCZxiBHnPd13g==',key_name='tempest-keypair-896312461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-5q306noz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3666d19053684843b400aab6ebf29cce',uuid=9e213b9c-23c4-4fe4-bd2f-2443ee3628bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG os_vif [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9d61f36-ee, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9d61f36-ee, col_values=(('external_ids', {'iface-id': 'b9d61f36-ee8c-4487-81e1-28d27592a092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:6e:38', 'vm-uuid': '9e213b9c-23c4-4fe4-bd2f-2443ee3628bc'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:11:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:40 user nova-compute[71063]: INFO os_vif [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee')
Apr 11 17:11:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:11:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:f6:6e:38, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:11:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updated VIF entry in instance network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:11:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:42 user nova-compute[71063]: WARNING nova.compute.manager [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state building and task_state spawning.
Apr 11 17:11:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233104.6746068, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Resumed (Lifecycle Event)
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance spawned successfully.
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:44 user nova-compute[71063]: WARNING nova.compute.manager [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state building and task_state spawning.
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233104.6750097, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Started (Lifecycle Event)
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 11 17:11:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:11:44 user nova-compute[71063]: INFO nova.compute.manager [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Took 6.77 seconds to build instance.
Apr 11 17:11:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.872s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:11:46 user nova-compute[71063]: INFO nova.compute.claims [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Claim successful on node user
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:11:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:11:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.policy [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:11:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Creating image(s)
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "/opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk 1073741824" returned: 0 in 0.065s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Cannot resize image /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'migration_context' on Instance uuid d87483a2-cf0e-465c-b486-361aba4c613a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Ensure instance console log exists: /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Successfully created port: 3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Successfully updated port: 3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-changed-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Refreshing instance network info cache due to event network-changed-3e2ec196-65df-4e44-adfd-613978e38721. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Acquiring lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Updating instance_info_cache with network_info: [{"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Instance network_info: |[{"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Acquired lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Refreshing network info cache for port 3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Start _get_guest_xml network_info=[{"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:11:49 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:49 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934361943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934361943',id=25,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-mr1gmr5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:11:47Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=d87483a2-cf0e-465c-b486-361aba4c613a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid d87483a2-cf0e-465c-b486-361aba4c613a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:11:49 user nova-compute[71063]:   <uuid>d87483a2-cf0e-465c-b486-361aba4c613a</uuid>
Apr 11 17:11:49 user nova-compute[71063]:   <name>instance-00000019</name>
Apr 11 17:11:49 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:11:49 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:11:49 user nova-compute[71063]:   <metadata>
Apr 11 17:11:49 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:11:49 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-934361943</nova:name>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:11:49</nova:creationTime>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:11:49 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:11:49 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:owner>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:11:49 user nova-compute[71063]:       </nova:owner>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:11:49 user nova-compute[71063]:       <nova:ports>
Apr 11 17:11:49 user nova-compute[71063]:         <nova:port uuid="3e2ec196-65df-4e44-adfd-613978e38721">
Apr 11 17:11:49 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 17:11:49 user nova-compute[71063]:         </nova:port>
Apr 11 17:11:49 user nova-compute[71063]:       </nova:ports>
Apr 11 17:11:49 user nova-compute[71063]:     </nova:instance>
Apr 11 17:11:49 user nova-compute[71063]:   </metadata>
Apr 11 17:11:49 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:11:49 user nova-compute[71063]:     <system>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="serial">d87483a2-cf0e-465c-b486-361aba4c613a</entry>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="uuid">d87483a2-cf0e-465c-b486-361aba4c613a</entry>
Apr 11 17:11:49 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:11:49 user nova-compute[71063]:     </system>
Apr 11 17:11:49 user nova-compute[71063]:   </sysinfo>
Apr 11 17:11:49 user nova-compute[71063]:   <os>
Apr 11 17:11:49 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:11:49 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:11:49 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:11:49 user nova-compute[71063]:   </os>
Apr 11 17:11:49 user nova-compute[71063]:   <features>
Apr 11 17:11:49 user nova-compute[71063]:     <acpi/>
Apr 11 17:11:49 user nova-compute[71063]:     <apic/>
Apr 11 17:11:49 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:11:49 user nova-compute[71063]:   </features>
Apr 11 17:11:49 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:11:49 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:11:49 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:11:49 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:11:49 user nova-compute[71063]:   </clock>
Apr 11 17:11:49 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:11:49 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:11:49 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:11:49 user nova-compute[71063]:   </cpu>
Apr 11 17:11:49 user nova-compute[71063]:   <devices>
Apr 11 17:11:49 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:11:49 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:11:49 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk"/>
Apr 11 17:11:49 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:11:49 user nova-compute[71063]:     </disk>
Apr 11 17:11:49 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:11:49 user nova-compute[71063]:       <mac address="fa:16:3e:ff:28:a3"/>
Apr 11 17:11:49 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:49 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:11:49 user nova-compute[71063]:       <target dev="tap3e2ec196-65"/>
Apr 11 17:11:49 user nova-compute[71063]:     </interface>
Apr 11 17:11:49 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:11:49 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/console.log" append="off"/>
Apr 11 17:11:49 user nova-compute[71063]:     </serial>
Apr 11 17:11:49 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:11:49 user nova-compute[71063]:     <video>
Apr 11 17:11:49 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:11:49 user nova-compute[71063]:     </video>
Apr 11 17:11:49 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:11:49 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:11:49 user nova-compute[71063]:     </rng>
Apr 11 17:11:49 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:11:49 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:11:49 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:11:49 user nova-compute[71063]:     </memballoon>
Apr 11 17:11:49 user nova-compute[71063]:   </devices>
Apr 11 17:11:49 user nova-compute[71063]: </domain>
Apr 11 17:11:49 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934361943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934361943',id=25,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-mr1gmr5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:11:47Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=d87483a2-cf0e-465c-b486-361aba4c613a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG os_vif [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e2ec196-65, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e2ec196-65, col_values=(('external_ids', {'iface-id': '3e2ec196-65df-4e44-adfd-613978e38721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:28:a3', 'vm-uuid': 'd87483a2-cf0e-465c-b486-361aba4c613a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:49 user nova-compute[71063]: INFO os_vif [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65')
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:ff:28:a3, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG nova.objects.instance [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'flavor' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:49 user nova-compute[71063]: INFO nova.compute.manager [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attaching volume c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 to /dev/vdb
Apr 11 17:11:49 user nova-compute[71063]: DEBUG os_brick.utils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d269590e-1776-4f63-8b50-eb2d25617120]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d44ee-7de2-40f1-bbef-f16baaf44910]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eec1954-3482-4d97-a411-b0c7dac79a6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bebe0f-9002-457f-9188-2f3a461db9af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:49 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:11:50 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90e02f-5ac9-4f6b-9785-120715a5903e]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG os_brick.utils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating existing volume attachment record: 5d83bf06-316b-4594-9b17-a479f2e853c6 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG nova.network.neutron [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Updated VIF entry in instance network info cache for port 3e2ec196-65df-4e44-adfd-613978e38721. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG nova.network.neutron [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Updating instance_info_cache with network_info: [{"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Releasing lock "refresh_cache-d87483a2-cf0e-465c-b486-361aba4c613a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:50 user nova-compute[71063]: DEBUG nova.compute.manager [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] No waiting events found dispatching network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:50 user nova-compute[71063]: WARNING nova.compute.manager [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received unexpected event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 for instance with vm_state building and task_state spawning.
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233112.7239676, d87483a2-cf0e-465c-b486-361aba4c613a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] VM Resumed (Lifecycle Event)
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Instance spawned successfully.
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233112.7286642, d87483a2-cf0e-465c-b486-361aba4c613a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] VM Started (Lifecycle Event)
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Took 5.79 seconds to spawn the instance on the hypervisor.
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] No waiting events found dispatching network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:11:52 user nova-compute[71063]: WARNING nova.compute.manager [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received unexpected event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 for instance with vm_state building and task_state spawning.
Apr 11 17:11:52 user nova-compute[71063]: INFO nova.compute.manager [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Took 6.65 seconds to build instance.
Apr 11 17:11:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.750s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:11:54 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:11:54 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:11:54 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6f7f03-8005-4e15-8ba6-54e073b596f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:11:54 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187fa4f-a013-405b-9a2e-67717da11b9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c1c492-00a7-4b2c-ad48-921538fd67e1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e031bc-0f7e-45d8-8166-ee40e616dc95]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje" returned: 0 in 0.147s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[02539640-bd9a-4dcc-8c46-5aa3a6520216]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpPIoVje'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[576dec99-8179-4aac-8c38-1300e9747f90]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[637707c9-2eba-469f-8f93-2e59c71631c7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fab59b-3b18-48e2-9e64-fda030f629c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:11:54 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8529b2-d5c4-420d-afbb-69dc3c72d25d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823d25a-f8c6-4cb4-b746-979c3779a3b7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:11:54 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.467s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb7f77c-0c69-4bba-aec8-1e4545d20243]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:11:54 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:11:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:11:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'flavor' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:11:56 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:11:56 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:11:56 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:11:56 user nova-compute[71063]:   <serial>c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4</serial>
Apr 11 17:11:56 user nova-compute[71063]: </disk>
Apr 11 17:11:56 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:6d:79:2f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:11:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.807s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Stashing vm_state: active {{(pid=71063) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_requests' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:11:58 user nova-compute[71063]: INFO nova.compute.claims [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Claim successful on node user
Apr 11 17:11:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:11:59 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating resource usage from migration 6cfd4117-0912-4615-8309-f7b12d6791d0
Apr 11 17:11:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.563s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:11:59 user nova-compute[71063]: INFO nova.compute.manager [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Migrating
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:59 user nova-compute[71063]: INFO nova.compute.rpcapi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:11:59 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Starting migrate_disk_and_power_off {{(pid=71063) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:00 user nova-compute[71063]: WARNING nova.compute.manager [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state resize_migrating.
Apr 11 17:12:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance destroyed successfully.
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b20a003-d5, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:01 user nova-compute[71063]: INFO os_vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:01 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87a5f5-bf60-44d3-8083-0a1687afb129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:12:01 user nova-compute[71063]: No targets found.
Apr 11 17:12:01 user nova-compute[71063]: iSNS:
Apr 11 17:12:01 user nova-compute[71063]: No targets found.
Apr 11 17:12:01 user nova-compute[71063]: STATIC:
Apr 11 17:12:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:12:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:12:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:12:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:01 user nova-compute[71063]: FIRMWARE:
Apr 11 17:12:01 user nova-compute[71063]: No targets found.
Apr 11 17:12:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:12:01 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:12:01 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d99956-5b72-4f80-bc39-b1b3a8ee6c24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2d192-4758-4e01-b946-f0576934b27e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d61e58-1b7b-4965-b05f-3f6d9568ac8d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7222e68-0578-4034-b9b5-ef3c317ae3b3]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fedc8-09ea-4573-bffd-78ac316db6a1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c142ca-c357-449e-affb-be274fbe166c]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ad923-da41-4cdb-bccc-85a80b4ba126]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be242f6-1713-44c1-b221-c00301326821]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:12:01 user nova-compute[71063]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbc5a7d-8b8a-4c60-a604-fb406fc0192f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (335ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_resize/disk /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "cp -r /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_resize/disk /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk" returned: 0 in 0.227s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_resize/disk.info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "cp -r /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_resize/disk.info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk.info" returned: 0 in 0.034s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:02 user nova-compute[71063]: WARNING nova.compute.manager [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state resize_migrating.
Apr 11 17:12:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Port 6b20a003-d501-4958-9c8c-567343698e97 binding to destination host user is already ACTIVE {{(pid=71063) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.utils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5733cd32-c1f2-428a-8767-35193eec7032]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46d870f-fc02-472a-9273-15443eedcca0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[551e85d1-dcc8-4fb6-b4c2-8ba6710b64ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc72b422-665b-48b7-9ad5-a732f34ebd0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:04 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750aac2-b3cb-41e5-8007-64d186138b52]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG os_brick.utils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:12:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Starting finish_migration {{(pid=71063) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:12:08 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating image(s)
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Cannot resize image /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Ensure instance console log exists: /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start _get_guest_xml network_info=[{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '2659b0ca-176e-4cd3-806c-680bc5593128', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1fc7677c-cbd9-48e7-be62-2210074bc87a', 'attached_at': '2023-04-11T17:12:08.000000', 'detached_at': '', 'volume_id': 'c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'serial': 'c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:12:08 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:08 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:12:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:09 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:09 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[431daf8c-e6e2-4557-8daf-2a0d1af97d83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:12:09 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[359de728-f1d4-40dc-92b6-6e525a180211]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[643021f3-46d0-40eb-b803-79b391a812cc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f4412-f2a9-4d43-b648-52e430436db5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1801e3ba-54e9-408c-a078-f0104947e84e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpPIoVje'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bed30e7-20e9-4b9d-b266-2408a07f1c2d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1236075c-8744-45fe-ac95-9ad42b78d7a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ada2a5-1c29-4ad6-b5ae-4882a6aa970a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:12:09 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89589618-1e52-497b-a570-19f28607b05a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2765e0-e846-4bbf-b3c7-60cf47f6316a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:09 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[edafd95c-f30e-4a80-abf3-c87721c3b328]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:12:10 user nova-compute[71063]:   <uuid>1fc7677c-cbd9-48e7-be62-2210074bc87a</uuid>
Apr 11 17:12:10 user nova-compute[71063]:   <name>instance-00000004</name>
Apr 11 17:12:10 user nova-compute[71063]:   <memory>196608</memory>
Apr 11 17:12:10 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:12:10 user nova-compute[71063]:   <metadata>
Apr 11 17:12:10 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:10 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-745930106</nova:name>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:12:08</nova:creationTime>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:flavor name="m1.micro">
Apr 11 17:12:10 user nova-compute[71063]:         <nova:memory>192</nova:memory>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:10 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:owner>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:12:10 user nova-compute[71063]:       </nova:owner>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:10 user nova-compute[71063]:       <nova:ports>
Apr 11 17:12:10 user nova-compute[71063]:         <nova:port uuid="6b20a003-d501-4958-9c8c-567343698e97">
Apr 11 17:12:10 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 17:12:10 user nova-compute[71063]:         </nova:port>
Apr 11 17:12:10 user nova-compute[71063]:       </nova:ports>
Apr 11 17:12:10 user nova-compute[71063]:     </nova:instance>
Apr 11 17:12:10 user nova-compute[71063]:   </metadata>
Apr 11 17:12:10 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:12:10 user nova-compute[71063]:     <system>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="serial">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="uuid">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:12:10 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:12:10 user nova-compute[71063]:     </system>
Apr 11 17:12:10 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:10 user nova-compute[71063]:   <os>
Apr 11 17:12:10 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:12:10 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:12:10 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:12:10 user nova-compute[71063]:   </os>
Apr 11 17:12:10 user nova-compute[71063]:   <features>
Apr 11 17:12:10 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:10 user nova-compute[71063]:     <apic/>
Apr 11 17:12:10 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:12:10 user nova-compute[71063]:   </features>
Apr 11 17:12:10 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:12:10 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:12:10 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:12:10 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:12:10 user nova-compute[71063]:   </clock>
Apr 11 17:12:10 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:12:10 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:12:10 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:12:10 user nova-compute[71063]:   </cpu>
Apr 11 17:12:10 user nova-compute[71063]:   <devices>
Apr 11 17:12:10 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:12:10 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:12:10 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk"/>
Apr 11 17:12:10 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:12:10 user nova-compute[71063]:     </disk>
Apr 11 17:12:10 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:12:10 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:10 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:12:10 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:12:10 user nova-compute[71063]:       <serial>c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4</serial>
Apr 11 17:12:10 user nova-compute[71063]:     </disk>
Apr 11 17:12:10 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:12:10 user nova-compute[71063]:       <mac address="fa:16:3e:6d:79:2f"/>
Apr 11 17:12:10 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:12:10 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:12:10 user nova-compute[71063]:       <target dev="tap6b20a003-d5"/>
Apr 11 17:12:10 user nova-compute[71063]:     </interface>
Apr 11 17:12:10 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:12:10 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log" append="off"/>
Apr 11 17:12:10 user nova-compute[71063]:     </serial>
Apr 11 17:12:10 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:12:10 user nova-compute[71063]:     <video>
Apr 11 17:12:10 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:12:10 user nova-compute[71063]:     </video>
Apr 11 17:12:10 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:12:10 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:12:10 user nova-compute[71063]:     </rng>
Apr 11 17:12:10 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:12:10 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:12:10 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:12:10 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:10 user nova-compute[71063]:   </devices>
Apr 11 17:12:10 user nova-compute[71063]: </domain>
Apr 11 17:12:10 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:6d:79:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG os_vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b20a003-d5, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b20a003-d5, col_values=(('external_ids', {'iface-id': '6b20a003-d501-4958-9c8c-567343698e97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:79:2f', 'vm-uuid': '1fc7677c-cbd9-48e7-be62-2210074bc87a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:10 user nova-compute[71063]: INFO os_vif [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:6d:79:2f, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 1fc7677c-cbd9-48e7-be62-2210074bc87a due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233134.1672857, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Resumed (Lifecycle Event)
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:14 user nova-compute[71063]: WARNING nova.compute.manager [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state resize_finish.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:14 user nova-compute[71063]: WARNING nova.compute.manager [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state resize_finish.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:14 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=26.312725067138672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance running successfully.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Failed to set time: agent not configured {{(pid=71063) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] finish_migration finished successfully. {{(pid=71063) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233134.1675062, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Started (Lifecycle Event)
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Applying migration context for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a as it has an incoming, in-progress migration 6cfd4117-0912-4615-8309-f7b12d6791d0. Migration status is finished {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 17:12:14 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating resource usage from migration 6cfd4117-0912-4615-8309-f7b12d6791d0
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9efebdaa-288e-42f5-af7d-ca64963be57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 5132062e-f602-4568-83ed-bc6fa2890300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance dba29188-c963-44d4-95fa-09bffbcb8dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Migration 6cfd4117-0912-4615-8309-f7b12d6791d0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:12:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2240MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:12:15 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:12:15 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:12:15 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:12:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-changed-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing instance network info cache due to event network-changed-d5605470-2058-46dd-bc30-a8f0ba8c82db. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing network info cache for port d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'pci_requests' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updated VIF entry in instance network info cache for port d5605470-2058-46dd-bc30-a8f0ba8c82db. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.network.neutron [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:21 user nova-compute[71063]: DEBUG nova.policy [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:12:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Successfully created port: e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Successfully updated port: e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-changed-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing instance network info cache due to event network-changed-e6963b86-72cc-4034-866e-6c009d0af81f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Refreshing network info cache for port e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG os_vif [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6963b86-72, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape6963b86-72, col_values=(('external_ids', {'iface-id': 'e6963b86-72cc-4034-866e-6c009d0af81f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:02:bb', 'vm-uuid': '9efebdaa-288e-42f5-af7d-ca64963be57a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: INFO os_vif [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72')
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] attach device xml: <interface type="ethernet">
Apr 11 17:12:24 user nova-compute[71063]:   <mac address="fa:16:3e:17:02:bb"/>
Apr 11 17:12:24 user nova-compute[71063]:   <model type="virtio"/>
Apr 11 17:12:24 user nova-compute[71063]:   <mtu size="1442"/>
Apr 11 17:12:24 user nova-compute[71063]:   <target dev="tape6963b86-72"/>
Apr 11 17:12:24 user nova-compute[71063]: </interface>
Apr 11 17:12:24 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:24 user nova-compute[71063]: WARNING nova.compute.manager [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f for instance with vm_state active and task_state None.
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:12:24 user nova-compute[71063]: INFO nova.compute.claims [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Claim successful on node user
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name hda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No VIF found with MAC fa:16:3e:6a:66:a9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:24 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:24</nova:creationTime>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:24 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:24 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:24 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:24 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:24 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:24 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:24 user nova-compute[71063]:     <nova:port uuid="e6963b86-72cc-4034-866e-6c009d0af81f">
Apr 11 17:12:24 user nova-compute[71063]:       <nova:ip type="fixed" address="10.10.10.91" ipVersion="4"/>
Apr 11 17:12:24 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:24 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:24 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:24 user nova-compute[71063]:  {{(pid=71063) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.782s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updated VIF entry in instance network info cache for port e6963b86-72cc-4034-866e-6c009d0af81f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Ignoring supplied device name: /dev/vdb
Apr 11 17:12:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.objects.instance [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:25 user nova-compute[71063]: INFO nova.compute.manager [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Attaching volume 0797f963-a3b2-4066-969d-a9be1a6c4c73 to /dev/vdb
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.utils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9f031-ffcd-4a5a-aa03-798a36a67f4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e00a43-396c-4bc7-abad-2a11ba0c657f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed421b4-b118-4840-83f0-669ef01d9c34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f20a09-5508-462d-a061-7d35669b3892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:25 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c5a56-b7b6-4760-bc59-2ea90647d7b2]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.utils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Updating existing volume attachment record: d5573c6b-b468-48d2-b655-6eb56d3813ad {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:25 user nova-compute[71063]: INFO nova.compute.manager [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Attaching volume fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 to /dev/vdb
Apr 11 17:12:25 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:12:25 user nova-compute[71063]: INFO nova.virt.block_device [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Booting with volume snapshot c8b61c1c-b4db-489e-89d8-80ebbf708f7e at /dev/vda
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.utils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.policy [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5953d-41a9-4726-a459-460dfa3ef26d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e89747-43b5-4d68-be65-94cf2a426b33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c4772-b2e8-4415-9c92-3621ef8cff09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[42440193-95e1-4199-a80b-5a49b7cd3be3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:25 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:12:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93afd4-7158-427c-be8f-0770779bff5d]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG os_brick.utils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:25 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating existing volume attachment record: a9f2d9fe-50e5-44db-a2eb-927e2e40f4fa {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Successfully created port: 5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:26 user nova-compute[71063]: WARNING nova.compute.manager [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f for instance with vm_state active and task_state None.
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Successfully updated port: 5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-changed-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Refreshing instance network info cache due to event network-changed-5ed86986-3eff-4f85-83ed-3db9257c5ec9. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Acquiring lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updating instance_info_cache with network_info: [{"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Instance network_info: |[{"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Acquired lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Refreshing network info cache for port 5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updated VIF entry in instance network info cache for port 5ed86986-3eff-4f85-83ed-3db9257c5ec9. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updating instance_info_cache with network_info: [{"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Releasing lock "refresh_cache-821c0f5c-2011-443d-9455-49cc9e317e33" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDwPATxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:29 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b215fd1-ea1b-4893-bc89-a0374cb7ffcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:12:29 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12ddbd-bc36-4882-9b75-55f3af041e29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73] added
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[021caaf4-3835-4946-8478-64b219a2d8e3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBrsioEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a5a06-d9c9-4967-be52-c31932f05bbf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDwPATxc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oDwPATxc" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d032cc-ada1-419b-980f-355649516c7d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oDwPATxc'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f135e-a0e8-407c-abc8-a6d321cbd16b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a093bf-1ecb-4d5b-b851-b847905b8a0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d9906-efc6-401b-8eec-989dc3b27a56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260]
Apr 11 17:12:29 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dadc54b-4987-4e9c-8bb9-970c2b21df6d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba780d7-ea6d-4984-8dc4-cad878eb2144]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:12:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa183c74-e2f1-4d77-a938-05710890c384]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDwPATxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23964623335356537', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964623335356537', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.244s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:31 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:31 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b582985-e0bc-4c52-a3d4-d4eb32875f30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:12:31 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d663f8e-1963-4dec-a14e-2d9e5b1c4bad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9] added
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:12:31 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:31 user nova-compute[71063]:   <source dev="/dev/sde"/>
Apr 11 17:12:31 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:31 user nova-compute[71063]:   <serial>0797f963-a3b2-4066-969d-a9be1a6c4c73</serial>
Apr 11 17:12:31 user nova-compute[71063]: </disk>
Apr 11 17:12:31 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b3e5ba-4fd8-4655-ac88-9431966c6bd7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc10db3-1a27-4911-b3c2-07349593fd1e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBrsioEM {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VBrsioEM" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f1996a-0dd2-4107-941e-14e128ccef1a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VBrsioEM'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8fea09-834b-4968-b8fb-a2a33c92a595]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf901a9b-5d57-4d0c-8776-75635a9f1bae]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c15ad08-f0a7-4745-9a29-e15b2c9500d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260]
Apr 11 17:12:31 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.utils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f8c4d-9aa9-470c-b399-0e8e5cb30180]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bce6e91-9ea9-4edd-85b5-46344c9d3fd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ffa63-a85b-48c4-9071-73e50bb2ca1e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)
Apr 11 17:12:31 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[475ae8cf-05b6-4784-a176-bc9146dc1225]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0df07a-b740-4235-99fd-32432753bb7e]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBrsioEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[66928ef5-21f7-44a8-ba09-1f0f3b173880]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[559daf78-63e0-4dea-8a85-943f7b36c2fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:12:31 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[067919a7-5fd7-4bc9-af9e-811a9bbcb1d3]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG os_brick.utils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updating existing volume attachment record: 7864fe20-7b54-4cd6-b247-1a07f4b802cc {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] No VIF found with MAC fa:16:3e:24:ac:4c, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:12:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.457s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] <== connect_volume: return (2578ms) {'type': 'block', 'scsi_wwn': '23130323664323737', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130323664323737', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:12:32 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:32 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:12:32 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:32 user nova-compute[71063]:   <serial>fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9</serial>
Apr 11 17:12:32 user nova-compute[71063]: </disk>
Apr 11 17:12:32 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No BDM found with device name hda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] No VIF found with MAC fa:16:3e:6a:66:a9, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:12:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.494s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:33 user nova-compute[71063]: INFO nova.compute.manager [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Detaching volume fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9
Apr 11 17:12:33 user nova-compute[71063]: INFO nova.virt.block_device [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Attempting to driver detach volume fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 from mountpoint /dev/vdb
Apr 11 17:12:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Attempting to detach device vdb from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:12:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:12:33 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:33 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:12:33 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:33 user nova-compute[71063]:   <serial>fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9</serial>
Apr 11 17:12:33 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 17:12:33 user nova-compute[71063]: </disk>
Apr 11 17:12:33 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully detached device vdb from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the persistent domain config.
Apr 11 17:12:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:12:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:12:33 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:33 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:12:33 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:33 user nova-compute[71063]:   <serial>fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9</serial>
Apr 11 17:12:33 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 17:12:33 user nova-compute[71063]: </disk>
Apr 11 17:12:33 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233154.1475995, 9efebdaa-288e-42f5-af7d-ca64963be57a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:12:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully detached device vdb from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the live domain config.
Apr 11 17:12:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VBrsioEM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[60945b58-1c2a-45e2-9616-99bfc65123a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:12:34 user nova-compute[71063]: No targets found.
Apr 11 17:12:34 user nova-compute[71063]: iSNS:
Apr 11 17:12:34 user nova-compute[71063]: No targets found.
Apr 11 17:12:34 user nova-compute[71063]: STATIC:
Apr 11 17:12:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:12:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73
Apr 11 17:12:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9
Apr 11 17:12:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:12:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:12:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:34 user nova-compute[71063]: FIRMWARE:
Apr 11 17:12:34 user nova-compute[71063]: No targets found.
Apr 11 17:12:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:12:34 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:12:34 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[69da438d-3651-4278-b877-58362a4f5f80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeb348d-8ae8-4523-8e89-ae56408639f3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 (non-flash)
Apr 11 17:12:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec1759ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee380907-fb61-4821-812a-2200d854af43]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[84495cd5-5312-48b0-b8b5-281694bf5a30]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c3aa1-9227-4b64-8911-0a01d951feff]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de8239a-b310-4f34-88ba-94da37a4e6e7]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2a237e-84c4-4c34-9ff7-a37af2dc1b57]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5776c836-16f8-4eec-8d8b-fbcfc4a09ce5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260]
Apr 11 17:12:34 user nova-compute[71063]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3feed7-fb16-43c8-8ca6-1223a0c8b414]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] <== disconnect_volume: return (341ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:12:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Creating image(s)
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Ensure instance console log exists: /opt/stack/data/nova/instances/821c0f5c-2011-443d-9455-49cc9e317e33/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Start _get_guest_xml network_info=[{"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '7864fe20-7b54-4cd6-b247-1a07f4b802cc', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuhZagke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '821c0f5c-2011-443d-9455-49cc9e317e33', 'attached_at': '', 'detached_at': '', 'volume_id': '88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 'serial': '88fbc7ce-cc86-48d1-95e4-aefcc3337ea8'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:12:36 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:36 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuhZagke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:36 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:36 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:36 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31aa51-e5a6-4844-a8dd-754657be0914]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:12:36 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839f2f2-996e-448b-a6dc-edb65f1eddee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8] added
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee94ec-122f-4e10-9291-15ac91dcf804]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.756s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1eebd-7c70-4b92-bf20-55b54a4306c2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuhZagke {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuhZagke" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[204fd32e-c8f1-41fc-9eff-752a01146a15]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuhZagke'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a813bb-557d-4157-bdf3-99da3c2fed07]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[87370082-4994-4e56-93bf-908561b24c34]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f744846e-f10f-48d2-9655-520d5610f2c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260]
Apr 11 17:12:36 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[177493cf-734b-4a13-bfa1-bcb1e7a6b87a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec6d505-7327-445f-9ccd-60e6534ed11c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[593e474d-76a3-451f-b3bf-0d3fefd69556]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-e6963b86-72cc-4034-866e-6c009d0af81f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-e6963b86-72cc-4034-866e-6c009d0af81f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Attempting to detach device tape6963b86-72 from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] detach device xml: <interface type="ethernet">
Apr 11 17:12:37 user nova-compute[71063]:   <mac address="fa:16:3e:17:02:bb"/>
Apr 11 17:12:37 user nova-compute[71063]:   <model type="virtio"/>
Apr 11 17:12:37 user nova-compute[71063]:   <mtu size="1442"/>
Apr 11 17:12:37 user nova-compute[71063]:   <target dev="tape6963b86-72"/>
Apr 11 17:12:37 user nova-compute[71063]: </interface>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface>not found in domain: <domain type='kvm' id='31'>
Apr 11 17:12:37 user nova-compute[71063]:   <name>instance-00000016</name>
Apr 11 17:12:37 user nova-compute[71063]:   <uuid>9efebdaa-288e-42f5-af7d-ca64963be57a</uuid>
Apr 11 17:12:37 user nova-compute[71063]:   <metadata>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:24</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="e6963b86-72cc-4034-866e-6c009d0af81f">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.10.10.91" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:   </metadata>
Apr 11 17:12:37 user nova-compute[71063]:   <memory unit='KiB'>131072</memory>
Apr 11 17:12:37 user nova-compute[71063]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 17:12:37 user nova-compute[71063]:   <vcpu placement='static'>1</vcpu>
Apr 11 17:12:37 user nova-compute[71063]:   <resource>
Apr 11 17:12:37 user nova-compute[71063]:     <partition>/machine</partition>
Apr 11 17:12:37 user nova-compute[71063]:   </resource>
Apr 11 17:12:37 user nova-compute[71063]:   <sysinfo type='smbios'>
Apr 11 17:12:37 user nova-compute[71063]:     <system>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='version'>0.0.0</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='serial'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='uuid'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='family'>Virtual Machine</entry>
Apr 11 17:12:37 user nova-compute[71063]:     </system>
Apr 11 17:12:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:37 user nova-compute[71063]:   <os>
Apr 11 17:12:37 user nova-compute[71063]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 17:12:37 user nova-compute[71063]:     <boot dev='hd'/>
Apr 11 17:12:37 user nova-compute[71063]:     <smbios mode='sysinfo'/>
Apr 11 17:12:37 user nova-compute[71063]:   </os>
Apr 11 17:12:37 user nova-compute[71063]:   <features>
Apr 11 17:12:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:37 user nova-compute[71063]:     <apic/>
Apr 11 17:12:37 user nova-compute[71063]:     <vmcoreinfo state='on'/>
Apr 11 17:12:37 user nova-compute[71063]:   </features>
Apr 11 17:12:37 user nova-compute[71063]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 17:12:37 user nova-compute[71063]:     <model fallback='forbid'>Nehalem</model>
Apr 11 17:12:37 user nova-compute[71063]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='vme'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='x2apic'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='hypervisor'/>
Apr 11 17:12:37 user nova-compute[71063]:   </cpu>
Apr 11 17:12:37 user nova-compute[71063]:   <clock offset='utc'>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='hpet' present='no'/>
Apr 11 17:12:37 user nova-compute[71063]:   </clock>
Apr 11 17:12:37 user nova-compute[71063]:   <on_poweroff>destroy</on_poweroff>
Apr 11 17:12:37 user nova-compute[71063]:   <on_reboot>restart</on_reboot>
Apr 11 17:12:37 user nova-compute[71063]:   <on_crash>destroy</on_crash>
Apr 11 17:12:37 user nova-compute[71063]:   <devices>
Apr 11 17:12:37 user nova-compute[71063]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='disk'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk' index='2'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore type='file' index='3'>
Apr 11 17:12:37 user nova-compute[71063]:         <format type='raw'/>
Apr 11 17:12:37 user nova-compute[71063]:         <source file='/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054'/>
Apr 11 17:12:37 user nova-compute[71063]:         <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       </backingStore>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='vda' bus='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='virtio-disk0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='cdrom'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config' index='1'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='hda' bus='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <readonly/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide0-0-0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='usb' index='0' model='none'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='usb'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='pci.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='ide' index='0'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type='ethernet'>
Apr 11 17:12:37 user nova-compute[71063]:       <mac address='fa:16:3e:6a:66:a9'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='tapd5605470-20'/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size='1442'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='net0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type='ethernet'>
Apr 11 17:12:37 user nova-compute[71063]:       <mac address='fa:16:3e:17:02:bb'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='tape6963b86-72'/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size='1442'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='net1'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <serial type='pty'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='isa-serial' port='0'>
Apr 11 17:12:37 user nova-compute[71063]:         <model name='isa-serial'/>
Apr 11 17:12:37 user nova-compute[71063]:       </target>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </serial>
Apr 11 17:12:37 user nova-compute[71063]:     <console type='pty' tty='/dev/pts/0'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='serial' port='0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </console>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='mouse' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='keyboard' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Apr 11 17:12:37 user nova-compute[71063]:       <listen type='address' address='0.0.0.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </graphics>
Apr 11 17:12:37 user nova-compute[71063]:     <audio id='1' type='none'/>
Apr 11 17:12:37 user nova-compute[71063]:     <video>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='video0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </video>
Apr 11 17:12:37 user nova-compute[71063]:     <memballoon model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <stats period='10'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='balloon0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:37 user nova-compute[71063]:     <rng model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <backend model='random'>/dev/urandom</backend>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='rng0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </rng>
Apr 11 17:12:37 user nova-compute[71063]:   </devices>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>+64055:+108</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]: </domain>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 17:12:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully detached device tape6963b86-72 from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the persistent domain config.
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] (1/8): Attempting to detach device tape6963b86-72 with device alias net1 from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] detach device xml: <interface type="ethernet">
Apr 11 17:12:37 user nova-compute[71063]:   <mac address="fa:16:3e:17:02:bb"/>
Apr 11 17:12:37 user nova-compute[71063]:   <model type="virtio"/>
Apr 11 17:12:37 user nova-compute[71063]:   <mtu size="1442"/>
Apr 11 17:12:37 user nova-compute[71063]:   <target dev="tape6963b86-72"/>
Apr 11 17:12:37 user nova-compute[71063]: </interface>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233157.268468, 9efebdaa-288e-42f5-af7d-ca64963be57a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Start waiting for the detach event from libvirt for device tape6963b86-72 with device alias net1 for instance 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface>not found in domain: <domain type='kvm' id='31'>
Apr 11 17:12:37 user nova-compute[71063]:   <name>instance-00000016</name>
Apr 11 17:12:37 user nova-compute[71063]:   <uuid>9efebdaa-288e-42f5-af7d-ca64963be57a</uuid>
Apr 11 17:12:37 user nova-compute[71063]:   <metadata>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:24</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="e6963b86-72cc-4034-866e-6c009d0af81f">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.10.10.91" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:   </metadata>
Apr 11 17:12:37 user nova-compute[71063]:   <memory unit='KiB'>131072</memory>
Apr 11 17:12:37 user nova-compute[71063]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 17:12:37 user nova-compute[71063]:   <vcpu placement='static'>1</vcpu>
Apr 11 17:12:37 user nova-compute[71063]:   <resource>
Apr 11 17:12:37 user nova-compute[71063]:     <partition>/machine</partition>
Apr 11 17:12:37 user nova-compute[71063]:   </resource>
Apr 11 17:12:37 user nova-compute[71063]:   <sysinfo type='smbios'>
Apr 11 17:12:37 user nova-compute[71063]:     <system>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='version'>0.0.0</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='serial'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='uuid'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='family'>Virtual Machine</entry>
Apr 11 17:12:37 user nova-compute[71063]:     </system>
Apr 11 17:12:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:37 user nova-compute[71063]:   <os>
Apr 11 17:12:37 user nova-compute[71063]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 17:12:37 user nova-compute[71063]:     <boot dev='hd'/>
Apr 11 17:12:37 user nova-compute[71063]:     <smbios mode='sysinfo'/>
Apr 11 17:12:37 user nova-compute[71063]:   </os>
Apr 11 17:12:37 user nova-compute[71063]:   <features>
Apr 11 17:12:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:37 user nova-compute[71063]:     <apic/>
Apr 11 17:12:37 user nova-compute[71063]:     <vmcoreinfo state='on'/>
Apr 11 17:12:37 user nova-compute[71063]:   </features>
Apr 11 17:12:37 user nova-compute[71063]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 17:12:37 user nova-compute[71063]:     <model fallback='forbid'>Nehalem</model>
Apr 11 17:12:37 user nova-compute[71063]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='vme'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='x2apic'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='hypervisor'/>
Apr 11 17:12:37 user nova-compute[71063]:   </cpu>
Apr 11 17:12:37 user nova-compute[71063]:   <clock offset='utc'>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='hpet' present='no'/>
Apr 11 17:12:37 user nova-compute[71063]:   </clock>
Apr 11 17:12:37 user nova-compute[71063]:   <on_poweroff>destroy</on_poweroff>
Apr 11 17:12:37 user nova-compute[71063]:   <on_reboot>restart</on_reboot>
Apr 11 17:12:37 user nova-compute[71063]:   <on_crash>destroy</on_crash>
Apr 11 17:12:37 user nova-compute[71063]:   <devices>
Apr 11 17:12:37 user nova-compute[71063]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='disk'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk' index='2'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore type='file' index='3'>
Apr 11 17:12:37 user nova-compute[71063]:         <format type='raw'/>
Apr 11 17:12:37 user nova-compute[71063]:         <source file='/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054'/>
Apr 11 17:12:37 user nova-compute[71063]:         <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       </backingStore>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='vda' bus='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='virtio-disk0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='cdrom'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config' index='1'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='hda' bus='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <readonly/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide0-0-0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='usb' index='0' model='none'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='usb'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='pci.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='ide' index='0'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type='ethernet'>
Apr 11 17:12:37 user nova-compute[71063]:       <mac address='fa:16:3e:6a:66:a9'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='tapd5605470-20'/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size='1442'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='net0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <serial type='pty'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='isa-serial' port='0'>
Apr 11 17:12:37 user nova-compute[71063]:         <model name='isa-serial'/>
Apr 11 17:12:37 user nova-compute[71063]:       </target>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </serial>
Apr 11 17:12:37 user nova-compute[71063]:     <console type='pty' tty='/dev/pts/0'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='serial' port='0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </console>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='mouse' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='keyboard' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Apr 11 17:12:37 user nova-compute[71063]:       <listen type='address' address='0.0.0.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </graphics>
Apr 11 17:12:37 user nova-compute[71063]:     <audio id='1' type='none'/>
Apr 11 17:12:37 user nova-compute[71063]:     <video>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='video0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </video>
Apr 11 17:12:37 user nova-compute[71063]:     <memballoon model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <stats period='10'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='balloon0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:37 user nova-compute[71063]:     <rng model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <backend model='random'>/dev/urandom</backend>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='rng0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </rng>
Apr 11 17:12:37 user nova-compute[71063]:   </devices>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>+64055:+108</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]: </domain>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 17:12:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully detached device tape6963b86-72 from instance 9efebdaa-288e-42f5-af7d-ca64963be57a from the live domain config.
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_vif [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6963b86-72, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: INFO os_vif [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72')
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:37</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-unplugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-unplugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:37 user nova-compute[71063]: WARNING nova.compute.manager [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-unplugged-e6963b86-72cc-4034-866e-6c009d0af81f for instance with vm_state active and task_state None.
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuhZagke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23730343465336437', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730343465336437', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735547101',display_name='tempest-TestVolumeBootPattern-server-1735547101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735547101',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r248ga5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:12:25Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=821c0f5c-2011-443d-9455-49cc9e317e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid 821c0f5c-2011-443d-9455-49cc9e317e33 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:12:37 user nova-compute[71063]:   <uuid>821c0f5c-2011-443d-9455-49cc9e317e33</uuid>
Apr 11 17:12:37 user nova-compute[71063]:   <name>instance-0000001a</name>
Apr 11 17:12:37 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:12:37 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:12:37 user nova-compute[71063]:   <metadata>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-server-1735547101</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:12:36</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:       <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:       </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:         <nova:port uuid="5ed86986-3eff-4f85-83ed-3db9257c5ec9">
Apr 11 17:12:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:       </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:   </metadata>
Apr 11 17:12:37 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:12:37 user nova-compute[71063]:     <system>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="serial">821c0f5c-2011-443d-9455-49cc9e317e33</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="uuid">821c0f5c-2011-443d-9455-49cc9e317e33</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:12:37 user nova-compute[71063]:     </system>
Apr 11 17:12:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:37 user nova-compute[71063]:   <os>
Apr 11 17:12:37 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:12:37 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:12:37 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:12:37 user nova-compute[71063]:   </os>
Apr 11 17:12:37 user nova-compute[71063]:   <features>
Apr 11 17:12:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:37 user nova-compute[71063]:     <apic/>
Apr 11 17:12:37 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:12:37 user nova-compute[71063]:   </features>
Apr 11 17:12:37 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:12:37 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:12:37 user nova-compute[71063]:   </clock>
Apr 11 17:12:37 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:12:37 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:12:37 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:12:37 user nova-compute[71063]:   </cpu>
Apr 11 17:12:37 user nova-compute[71063]:   <devices>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:12:37 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:37 user nova-compute[71063]:       <source dev="/dev/sdf"/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:12:37 user nova-compute[71063]:       <serial>88fbc7ce-cc86-48d1-95e4-aefcc3337ea8</serial>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:12:37 user nova-compute[71063]:       <mac address="fa:16:3e:90:08:df"/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev="tap5ed86986-3e"/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:12:37 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/821c0f5c-2011-443d-9455-49cc9e317e33/console.log" append="off"/>
Apr 11 17:12:37 user nova-compute[71063]:     </serial>
Apr 11 17:12:37 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:     <video>
Apr 11 17:12:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:12:37 user nova-compute[71063]:     </video>
Apr 11 17:12:37 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:12:37 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:12:37 user nova-compute[71063]:     </rng>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:12:37 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:12:37 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:12:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:37 user nova-compute[71063]:   </devices>
Apr 11 17:12:37 user nova-compute[71063]: </domain>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735547101',display_name='tempest-TestVolumeBootPattern-server-1735547101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735547101',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r248ga5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:12:25Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=821c0f5c-2011-443d-9455-49cc9e317e33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_vif [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed86986-3e, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ed86986-3e, col_values=(('external_ids', {'iface-id': '5ed86986-3eff-4f85-83ed-3db9257c5ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:08:df', 'vm-uuid': '821c0f5c-2011-443d-9455-49cc9e317e33'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: INFO os_vif [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e')
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:90:08:df, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-deleted-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:37 user nova-compute[71063]: INFO nova.compute.manager [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Neutron deleted interface e6963b86-72cc-4034-866e-6c009d0af81f; detaching it from the instance and deleting it from the info cache
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquired lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.objects.instance [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Lazy-loading 'system_metadata' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.objects.instance [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Lazy-loading 'flavor' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: INFO nova.compute.manager [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Detaching volume 0797f963-a3b2-4066-969d-a9be1a6c4c73
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface>not found in domain: <domain type='kvm' id='31'>
Apr 11 17:12:37 user nova-compute[71063]:   <name>instance-00000016</name>
Apr 11 17:12:37 user nova-compute[71063]:   <uuid>9efebdaa-288e-42f5-af7d-ca64963be57a</uuid>
Apr 11 17:12:37 user nova-compute[71063]:   <metadata>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:37</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:   </metadata>
Apr 11 17:12:37 user nova-compute[71063]:   <memory unit='KiB'>131072</memory>
Apr 11 17:12:37 user nova-compute[71063]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 17:12:37 user nova-compute[71063]:   <vcpu placement='static'>1</vcpu>
Apr 11 17:12:37 user nova-compute[71063]:   <resource>
Apr 11 17:12:37 user nova-compute[71063]:     <partition>/machine</partition>
Apr 11 17:12:37 user nova-compute[71063]:   </resource>
Apr 11 17:12:37 user nova-compute[71063]:   <sysinfo type='smbios'>
Apr 11 17:12:37 user nova-compute[71063]:     <system>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='version'>0.0.0</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='serial'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='uuid'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='family'>Virtual Machine</entry>
Apr 11 17:12:37 user nova-compute[71063]:     </system>
Apr 11 17:12:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:37 user nova-compute[71063]:   <os>
Apr 11 17:12:37 user nova-compute[71063]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 17:12:37 user nova-compute[71063]:     <boot dev='hd'/>
Apr 11 17:12:37 user nova-compute[71063]:     <smbios mode='sysinfo'/>
Apr 11 17:12:37 user nova-compute[71063]:   </os>
Apr 11 17:12:37 user nova-compute[71063]:   <features>
Apr 11 17:12:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:37 user nova-compute[71063]:     <apic/>
Apr 11 17:12:37 user nova-compute[71063]:     <vmcoreinfo state='on'/>
Apr 11 17:12:37 user nova-compute[71063]:   </features>
Apr 11 17:12:37 user nova-compute[71063]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 17:12:37 user nova-compute[71063]:     <model fallback='forbid'>Nehalem</model>
Apr 11 17:12:37 user nova-compute[71063]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='vme'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='x2apic'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='hypervisor'/>
Apr 11 17:12:37 user nova-compute[71063]:   </cpu>
Apr 11 17:12:37 user nova-compute[71063]:   <clock offset='utc'>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='hpet' present='no'/>
Apr 11 17:12:37 user nova-compute[71063]:   </clock>
Apr 11 17:12:37 user nova-compute[71063]:   <on_poweroff>destroy</on_poweroff>
Apr 11 17:12:37 user nova-compute[71063]:   <on_reboot>restart</on_reboot>
Apr 11 17:12:37 user nova-compute[71063]:   <on_crash>destroy</on_crash>
Apr 11 17:12:37 user nova-compute[71063]:   <devices>
Apr 11 17:12:37 user nova-compute[71063]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='disk'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk' index='2'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore type='file' index='3'>
Apr 11 17:12:37 user nova-compute[71063]:         <format type='raw'/>
Apr 11 17:12:37 user nova-compute[71063]:         <source file='/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054'/>
Apr 11 17:12:37 user nova-compute[71063]:         <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       </backingStore>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='vda' bus='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='virtio-disk0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='cdrom'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config' index='1'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='hda' bus='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <readonly/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide0-0-0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='usb' index='0' model='none'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='usb'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='pci.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='ide' index='0'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type='ethernet'>
Apr 11 17:12:37 user nova-compute[71063]:       <mac address='fa:16:3e:6a:66:a9'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='tapd5605470-20'/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size='1442'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='net0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <serial type='pty'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='isa-serial' port='0'>
Apr 11 17:12:37 user nova-compute[71063]:         <model name='isa-serial'/>
Apr 11 17:12:37 user nova-compute[71063]:       </target>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </serial>
Apr 11 17:12:37 user nova-compute[71063]:     <console type='pty' tty='/dev/pts/0'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='serial' port='0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </console>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='mouse' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='keyboard' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Apr 11 17:12:37 user nova-compute[71063]:       <listen type='address' address='0.0.0.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </graphics>
Apr 11 17:12:37 user nova-compute[71063]:     <audio id='1' type='none'/>
Apr 11 17:12:37 user nova-compute[71063]:     <video>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='video0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </video>
Apr 11 17:12:37 user nova-compute[71063]:     <memballoon model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <stats period='10'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='balloon0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:37 user nova-compute[71063]:     <rng model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <backend model='random'>/dev/urandom</backend>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='rng0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </rng>
Apr 11 17:12:37 user nova-compute[71063]:   </devices>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>+64055:+108</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]: </domain>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface> {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:17:02:bb"/><model type="virtio"/><mtu size="1442"/><target dev="tape6963b86-72"/></interface>not found in domain: <domain type='kvm' id='31'>
Apr 11 17:12:37 user nova-compute[71063]:   <name>instance-00000016</name>
Apr 11 17:12:37 user nova-compute[71063]:   <uuid>9efebdaa-288e-42f5-af7d-ca64963be57a</uuid>
Apr 11 17:12:37 user nova-compute[71063]:   <metadata>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:37 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:37</nova:creationTime>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:37 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:37 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:37 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:37 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:37 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:37 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:37 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:37 user nova-compute[71063]:   </metadata>
Apr 11 17:12:37 user nova-compute[71063]:   <memory unit='KiB'>131072</memory>
Apr 11 17:12:37 user nova-compute[71063]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 17:12:37 user nova-compute[71063]:   <vcpu placement='static'>1</vcpu>
Apr 11 17:12:37 user nova-compute[71063]:   <resource>
Apr 11 17:12:37 user nova-compute[71063]:     <partition>/machine</partition>
Apr 11 17:12:37 user nova-compute[71063]:   </resource>
Apr 11 17:12:37 user nova-compute[71063]:   <sysinfo type='smbios'>
Apr 11 17:12:37 user nova-compute[71063]:     <system>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='version'>0.0.0</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='serial'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='uuid'>9efebdaa-288e-42f5-af7d-ca64963be57a</entry>
Apr 11 17:12:37 user nova-compute[71063]:       <entry name='family'>Virtual Machine</entry>
Apr 11 17:12:37 user nova-compute[71063]:     </system>
Apr 11 17:12:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:12:37 user nova-compute[71063]:   <os>
Apr 11 17:12:37 user nova-compute[71063]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 17:12:37 user nova-compute[71063]:     <boot dev='hd'/>
Apr 11 17:12:37 user nova-compute[71063]:     <smbios mode='sysinfo'/>
Apr 11 17:12:37 user nova-compute[71063]:   </os>
Apr 11 17:12:37 user nova-compute[71063]:   <features>
Apr 11 17:12:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:12:37 user nova-compute[71063]:     <apic/>
Apr 11 17:12:37 user nova-compute[71063]:     <vmcoreinfo state='on'/>
Apr 11 17:12:37 user nova-compute[71063]:   </features>
Apr 11 17:12:37 user nova-compute[71063]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 17:12:37 user nova-compute[71063]:     <model fallback='forbid'>Nehalem</model>
Apr 11 17:12:37 user nova-compute[71063]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='vme'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='x2apic'/>
Apr 11 17:12:37 user nova-compute[71063]:     <feature policy='require' name='hypervisor'/>
Apr 11 17:12:37 user nova-compute[71063]:   </cpu>
Apr 11 17:12:37 user nova-compute[71063]:   <clock offset='utc'>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 17:12:37 user nova-compute[71063]:     <timer name='hpet' present='no'/>
Apr 11 17:12:37 user nova-compute[71063]:   </clock>
Apr 11 17:12:37 user nova-compute[71063]:   <on_poweroff>destroy</on_poweroff>
Apr 11 17:12:37 user nova-compute[71063]:   <on_reboot>restart</on_reboot>
Apr 11 17:12:37 user nova-compute[71063]:   <on_crash>destroy</on_crash>
Apr 11 17:12:37 user nova-compute[71063]:   <devices>
Apr 11 17:12:37 user nova-compute[71063]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='disk'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk' index='2'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore type='file' index='3'>
Apr 11 17:12:37 user nova-compute[71063]:         <format type='raw'/>
Apr 11 17:12:37 user nova-compute[71063]:         <source file='/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054'/>
Apr 11 17:12:37 user nova-compute[71063]:         <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       </backingStore>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='vda' bus='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='virtio-disk0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <disk type='file' device='cdrom'>
Apr 11 17:12:37 user nova-compute[71063]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 17:12:37 user nova-compute[71063]:       <source file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk.config' index='1'/>
Apr 11 17:12:37 user nova-compute[71063]:       <backingStore/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='hda' bus='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <readonly/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide0-0-0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </disk>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='usb' index='0' model='none'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='usb'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='pci.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <controller type='ide' index='0'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='ide'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </controller>
Apr 11 17:12:37 user nova-compute[71063]:     <interface type='ethernet'>
Apr 11 17:12:37 user nova-compute[71063]:       <mac address='fa:16:3e:6a:66:a9'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target dev='tapd5605470-20'/>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio'/>
Apr 11 17:12:37 user nova-compute[71063]:       <mtu size='1442'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='net0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </interface>
Apr 11 17:12:37 user nova-compute[71063]:     <serial type='pty'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='isa-serial' port='0'>
Apr 11 17:12:37 user nova-compute[71063]:         <model name='isa-serial'/>
Apr 11 17:12:37 user nova-compute[71063]:       </target>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </serial>
Apr 11 17:12:37 user nova-compute[71063]:     <console type='pty' tty='/dev/pts/0'>
Apr 11 17:12:37 user nova-compute[71063]:       <source path='/dev/pts/0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <log file='/opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/console.log' append='off'/>
Apr 11 17:12:37 user nova-compute[71063]:       <target type='serial' port='0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='serial0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </console>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='mouse' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <input type='keyboard' bus='ps2'>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='input1'/>
Apr 11 17:12:37 user nova-compute[71063]:     </input>
Apr 11 17:12:37 user nova-compute[71063]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
Apr 11 17:12:37 user nova-compute[71063]:       <listen type='address' address='0.0.0.0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </graphics>
Apr 11 17:12:37 user nova-compute[71063]:     <audio id='1' type='none'/>
Apr 11 17:12:37 user nova-compute[71063]:     <video>
Apr 11 17:12:37 user nova-compute[71063]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='video0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </video>
Apr 11 17:12:37 user nova-compute[71063]:     <memballoon model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <stats period='10'/>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='balloon0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:12:37 user nova-compute[71063]:     <rng model='virtio'>
Apr 11 17:12:37 user nova-compute[71063]:       <backend model='random'>/dev/urandom</backend>
Apr 11 17:12:37 user nova-compute[71063]:       <alias name='rng0'/>
Apr 11 17:12:37 user nova-compute[71063]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 17:12:37 user nova-compute[71063]:     </rng>
Apr 11 17:12:37 user nova-compute[71063]:   </devices>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>libvirt-9efebdaa-288e-42f5-af7d-ca64963be57a</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 17:12:37 user nova-compute[71063]:     <label>+64055:+108</label>
Apr 11 17:12:37 user nova-compute[71063]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 17:12:37 user nova-compute[71063]:   </seclabel>
Apr 11 17:12:37 user nova-compute[71063]: </domain>
Apr 11 17:12:37 user nova-compute[71063]:  {{(pid=71063) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 17:12:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Detaching interface fa:16:3e:17:02:bb failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tape6963b86-72' not found.
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Converting VIF {"id": "e6963b86-72cc-4034-866e-6c009d0af81f", "address": "fa:16:3e:17:02:bb", "network": {"id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1472137873", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6963b86-72", "ovs_interfaceid": "e6963b86-72cc-4034-866e-6c009d0af81f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG os_vif [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6963b86-72, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:12:38 user nova-compute[71063]: INFO os_vif [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:02:bb,bridge_name='br-int',has_traffic_filtering=True,id=e6963b86-72cc-4034-866e-6c009d0af81f,network=Network(5485eb75-ad94-4060-9bd6-b8c22408ce41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6963b86-72')
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:12:38 user nova-compute[71063]:   <nova:package version="0.0.0"/>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:name>tempest-device-tagging-server-1021636219</nova:name>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:creationTime>2023-04-11 17:12:37</nova:creationTime>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:flavor name="m1.nano">
Apr 11 17:12:38 user nova-compute[71063]:     <nova:memory>128</nova:memory>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:disk>1</nova:disk>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:swap>0</nova:swap>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:vcpus>1</nova:vcpus>
Apr 11 17:12:38 user nova-compute[71063]:   </nova:flavor>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:owner>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:user uuid="1a78f1b0eaee488f89af2d7d82cd9e08">tempest-TaggedAttachmentsTest-1294682350-project-member</nova:user>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:project uuid="ec2d39b4dbd0440c93734b0bab463b11">tempest-TaggedAttachmentsTest-1294682350</nova:project>
Apr 11 17:12:38 user nova-compute[71063]:   </nova:owner>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:12:38 user nova-compute[71063]:   <nova:ports>
Apr 11 17:12:38 user nova-compute[71063]:     <nova:port uuid="d5605470-2058-46dd-bc30-a8f0ba8c82db">
Apr 11 17:12:38 user nova-compute[71063]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:12:38 user nova-compute[71063]:     </nova:port>
Apr 11 17:12:38 user nova-compute[71063]:   </nova:ports>
Apr 11 17:12:38 user nova-compute[71063]: </nova:instance>
Apr 11 17:12:38 user nova-compute[71063]:  {{(pid=71063) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 17:12:38 user nova-compute[71063]: INFO nova.virt.block_device [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Attempting to driver detach volume 0797f963-a3b2-4066-969d-a9be1a6c4c73 from mountpoint /dev/vdb
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Attempting to detach device vdb from instance 5132062e-f602-4568-83ed-bc6fa2890300 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:12:38 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:38 user nova-compute[71063]:   <source dev="/dev/sde"/>
Apr 11 17:12:38 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:38 user nova-compute[71063]:   <serial>0797f963-a3b2-4066-969d-a9be1a6c4c73</serial>
Apr 11 17:12:38 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:12:38 user nova-compute[71063]: </disk>
Apr 11 17:12:38 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully detached device vdb from instance 5132062e-f602-4568-83ed-bc6fa2890300 from the persistent domain config.
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5132062e-f602-4568-83ed-bc6fa2890300 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:12:38 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:12:38 user nova-compute[71063]:   <source dev="/dev/sde"/>
Apr 11 17:12:38 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:12:38 user nova-compute[71063]:   <serial>0797f963-a3b2-4066-969d-a9be1a6c4c73</serial>
Apr 11 17:12:38 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:12:38 user nova-compute[71063]: </disk>
Apr 11 17:12:38 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [{"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Releasing lock "refresh_cache-9efebdaa-288e-42f5-af7d-ca64963be57a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "interface-9efebdaa-288e-42f5-af7d-ca64963be57a-e6963b86-72cc-4034-866e-6c009d0af81f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.537s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233158.673482, 5132062e-f602-4568-83ed-bc6fa2890300 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:12:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully detached device vdb from instance 5132062e-f602-4568-83ed-bc6fa2890300 from the live domain config.
Apr 11 17:12:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDwPATxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[949de40a-1d4e-4424-8071-1a3c1e6868bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:12:38 user nova-compute[71063]: No targets found.
Apr 11 17:12:38 user nova-compute[71063]: iSNS:
Apr 11 17:12:38 user nova-compute[71063]: No targets found.
Apr 11 17:12:38 user nova-compute[71063]: STATIC:
Apr 11 17:12:38 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:12:38 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:38 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:38 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8
Apr 11 17:12:38 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:38 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:38 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73
Apr 11 17:12:38 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:38 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:38 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:12:38 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:38 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:38 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:12:38 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:38 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:38 user nova-compute[71063]: FIRMWARE:
Apr 11 17:12:38 user nova-compute[71063]: No targets found.
Apr 11 17:12:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:12:38 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:12:38 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2240668e-15cd-48e4-85ae-69047072c415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4931cffb-dc78-4c39-b741-6e438a0711e5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbea460caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73'): ({'sde'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Removing single pathed devices sde {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63066d4f-cdbb-4d91-98fc-01ff9bbf5793]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdc8f5b-a578-4878-92e5-bac71e6a18b1]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flushing IO for device /dev/sde {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[44815131-62f6-445c-8668-3881ec74339e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[13565949-f89f-46ac-8e7c-158b07d96aff]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b64f5-a747-409d-bba6-6c55f3582e64]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ce15a4-6764-419c-858f-9c9ef4883ba9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260]
Apr 11 17:12:38 user nova-compute[71063]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73, portal: 172.16.0.220,3260] successful.
Apr 11 17:12:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836455f-3a0e-4063-8303-de266d58dbb4]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== disconnect_volume: return (328ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:39 user nova-compute[71063]: WARNING nova.compute.manager [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-e6963b86-72cc-4034-866e-6c009d0af81f for instance with vm_state active and task_state None.
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] No waiting events found dispatching network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:39 user nova-compute[71063]: WARNING nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received unexpected event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance with vm_state building and task_state spawning.
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] No waiting events found dispatching network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:39 user nova-compute[71063]: WARNING nova.compute.manager [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received unexpected event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance with vm_state building and task_state spawning.
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'flavor' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.018s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.886s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:39 user nova-compute[71063]: INFO nova.compute.manager [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Terminating instance
Apr 11 17:12:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Instance destroyed successfully.
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'resources' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-802621587',display_name='tempest-VolumesSnapshotTestJSON-instance-802621587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-802621587',id=23,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ab7d4c5adc544ef9ed9f774e1e144cc',ramdisk_id='',reservation_id='r-r31jnoj8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1455403265',owner_user_name='tempest-VolumesSnapshotTestJSON-1455403265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:42Z,user_data=None,user_id='2878fecd141a4c0f97ead618b9cfdcbf',uuid=5132062e-f602-4568-83ed-bc6fa2890300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converting VIF {"id": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "address": "fa:16:3e:24:ac:4c", "network": {"id": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-826068908-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ab7d4c5adc544ef9ed9f774e1e144cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cb911aa-77", "ovs_interfaceid": "3cb911aa-7791-4ad0-af48-0e70fcd29e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_vif [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cb911aa-77, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:40 user nova-compute[71063]: INFO os_vif [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:ac:4c,bridge_name='br-int',has_traffic_filtering=True,id=3cb911aa-7791-4ad0-af48-0e70fcd29e68,network=Network(cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cb911aa-77')
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oDwPATxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:12:40 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[18568b30-9f70-487b-a37f-0bd15706e325]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:12:40 user nova-compute[71063]: No targets found.
Apr 11 17:12:40 user nova-compute[71063]: iSNS:
Apr 11 17:12:40 user nova-compute[71063]: No targets found.
Apr 11 17:12:40 user nova-compute[71063]: STATIC:
Apr 11 17:12:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:12:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8
Apr 11 17:12:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:12:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:12:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:12:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:12:40 user nova-compute[71063]: FIRMWARE:
Apr 11 17:12:40 user nova-compute[71063]: No targets found.
Apr 11 17:12:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:12:40 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:12:40 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0797f963-a3b2-4066-969d-a9be1a6c4c73', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9022eb24-01fb-4a83-b3ca-6ebc480e1d52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[babec572-4b4c-4f91-91ad-6d42f5458733]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:12:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe806463b0>, {}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Disconnecting from: [] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] <== disconnect_volume: return (78ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:12:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Deleting instance files /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300_del
Apr 11 17:12:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Deletion of /opt/stack/data/nova/instances/5132062e-f602-4568-83ed-bc6fa2890300_del complete
Apr 11 17:12:40 user nova-compute[71063]: INFO nova.compute.manager [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 11 17:12:40 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:12:40 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Took 0.46 seconds to deallocate network for instance.
Apr 11 17:12:41 user nova-compute[71063]: WARNING nova.volume.cinder [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Attachment d5573c6b-b468-48d2-b655-6eb56d3813ad does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d5573c6b-b468-48d2-b655-6eb56d3813ad. (HTTP 404) (Request-ID: req-eba37a2e-05bc-4e80-a6eb-d5b58b5dc927)
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233161.4292736, 821c0f5c-2011-443d-9455-49cc9e317e33 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] VM Resumed (Lifecycle Event)
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Instance spawned successfully.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233161.4295962, 821c0f5c-2011-443d-9455-49cc9e317e33 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] VM Started (Lifecycle Event)
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-vif-unplugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] No waiting events found dispatching network-vif-unplugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:41 user nova-compute[71063]: WARNING nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received unexpected event network-vif-unplugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance with vm_state deleted and task_state None.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Acquiring lock "5132062e-f602-4568-83ed-bc6fa2890300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "5132062e-f602-4568-83ed-bc6fa2890300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] No waiting events found dispatching network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:41 user nova-compute[71063]: WARNING nova.compute.manager [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received unexpected event network-vif-plugged-3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance with vm_state deleted and task_state None.
Apr 11 17:12:41 user nova-compute[71063]: INFO nova.compute.manager [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Took 17.06 seconds to build instance.
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.205s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Received event network-vif-deleted-3cb911aa-7791-4ad0-af48-0e70fcd29e68 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:42 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Deleted allocations for instance 5132062e-f602-4568-83ed-bc6fa2890300
Apr 11 17:12:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "5132062e-f602-4568-83ed-bc6fa2890300" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:46 user nova-compute[71063]: INFO nova.compute.manager [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Terminating instance
Apr 11 17:12:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-unplugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:12:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Instance destroyed successfully.
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'resources' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1659221805',display_name='tempest-AttachVolumeTestJSON-server-1659221805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1659221805',id=7,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww==',key_name='tempest-keypair-449429725',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-7dcbl00t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "address": "fa:16:3e:42:9e:29", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b4b45a7-1e", "ovs_interfaceid": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG os_vif [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b4b45a7-1e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:47 user nova-compute[71063]: INFO os_vif [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:9e:29,bridge_name='br-int',has_traffic_filtering=True,id=8b4b45a7-1e14-4c93-a6a9-fe814512cef2,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b4b45a7-1e')
Apr 11 17:12:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Deleting instance files /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32_del
Apr 11 17:12:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Deletion of /opt/stack/data/nova/instances/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32_del complete
Apr 11 17:12:47 user nova-compute[71063]: INFO nova.compute.manager [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 17:12:47 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:12:47 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:12:48 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Took 1.20 seconds to deallocate network for instance.
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Acquiring lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] No waiting events found dispatching network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:12:48 user nova-compute[71063]: WARNING nova.compute.manager [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received unexpected event network-vif-plugged-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance with vm_state deleted and task_state None.
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Received event network-vif-deleted-8b4b45a7-1e14-4c93-a6a9-fe814512cef2 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:48 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Deleted allocations for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32
Apr 11 17:12:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:12:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:55 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233160.7324648, 5132062e-f602-4568-83ed-bc6fa2890300 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:12:55 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] VM Stopped (Lifecycle Event)
Apr 11 17:12:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c43f5e9f-6336-4c27-8086-c938e624bfbd None None] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:12:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:12:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:02 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233167.0022383, d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:02 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] VM Stopped (Lifecycle Event)
Apr 11 17:13:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-29fdf25a-845f-4943-8738-77faa1c12acc None None] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:13:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing instance network info cache due to event network-changed-fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Acquiring lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Acquired lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Refreshing network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:10 user nova-compute[71063]: INFO nova.compute.manager [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Terminating instance
Apr 11 17:13:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:13:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-unplugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updated VIF entry in instance network info cache for port fe9d8f85-8c07-4fef-ac72-417df1310bd3. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [{"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Releasing lock "refresh_cache-dba29188-c963-44d4-95fa-09bffbcb8dca" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:13:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Instance destroyed successfully.
Apr 11 17:13:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'resources' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-263726245',display_name='tempest-TestShelveInstance-server-263726245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-263726245',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1iD/M9MyvgtRPwRjRcQanIre2nNXOXBvUg4AGkq7sAV6+m5pBZBbB9GJsn7+K0l8XV22PLOcPZAVhc0KhDPSgFmZjERVUBTk3/Eey+mjvEgyssoBy0YWVpHwpdZYxig==',key_name='tempest-TestShelveInstance-1839642534',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf2f734d27a049e7b97ba50db0db0b6c',ramdisk_id='',reservation_id='r-4z0elqjm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-720963145',owner_user_name='tempest-TestShelveInstance-720963145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:11:32Z,user_data=None,user_id='ea404079db924f70b4a22278cee452dc',uuid=dba29188-c963-44d4-95fa-09bffbcb8dca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converting VIF {"id": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "address": "fa:16:3e:fd:41:f9", "network": {"id": "725f2a46-c18b-4884-8982-1dd55f06826d", "bridge": "br-int", "label": "tempest-TestShelveInstance-1977962181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf2f734d27a049e7b97ba50db0db0b6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe9d8f85-8c", "ovs_interfaceid": "fe9d8f85-8c07-4fef-ac72-417df1310bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_vif [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe9d8f85-8c, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:13:12 user nova-compute[71063]: INFO os_vif [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:41:f9,bridge_name='br-int',has_traffic_filtering=True,id=fe9d8f85-8c07-4fef-ac72-417df1310bd3,network=Network(725f2a46-c18b-4884-8982-1dd55f06826d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe9d8f85-8c')
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DzvRkVNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:12 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5cfa72-51fb-4dc3-a7eb-a24d49cf5323]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:13:12 user nova-compute[71063]: No targets found.
Apr 11 17:13:12 user nova-compute[71063]: iSNS:
Apr 11 17:13:12 user nova-compute[71063]: No targets found.
Apr 11 17:13:12 user nova-compute[71063]: STATIC:
Apr 11 17:13:12 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:13:12 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:12 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:12 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8
Apr 11 17:13:12 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:12 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:12 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:13:12 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:12 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:12 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805
Apr 11 17:13:12 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:12 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:12 user nova-compute[71063]: FIRMWARE:
Apr 11 17:13:12 user nova-compute[71063]: No targets found.
Apr 11 17:13:12 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:13:12 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:13:12 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[752fdfc2-61bb-4496-b147-c5740d8af01d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08b7afa-b445-4c3f-88dc-35f114479af0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:12 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80400b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d7991-1c4d-40fd-a982-22e149aa4291]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70ef1e2-a31a-43e7-816f-34de111764a6]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d3973-9be3-43a8-9304-0efbe0869279]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[720f4232-d744-4d7f-af7e-e2f843f68c01]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f00a0f-469a-4ba7-a60b-edb521f2ed49]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069d36c-4ad9-437d-ab94-0be1cf555a61]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260]
Apr 11 17:13:12 user nova-compute[71063]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805, portal: 172.16.0.220,3260] successful.
Apr 11 17:13:12 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbbb37a6-c422-4ef3-98c9-e208a1934805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57629-e703-4743-aa52-d9a15faa44ed]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] <== disconnect_volume: return (349ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:13:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deleting instance files /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca_del
Apr 11 17:13:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deletion of /opt/stack/data/nova/instances/dba29188-c963-44d4-95fa-09bffbcb8dca_del complete
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: INFO nova.compute.manager [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Took 1.56 seconds to destroy the instance on the hypervisor.
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-deleted-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:12 user nova-compute[71063]: INFO nova.compute.manager [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Neutron deleted interface fe9d8f85-8c07-4fef-ac72-417df1310bd3; detaching it from the instance and deleting it from the info cache
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Took 0.49 seconds to deallocate network for instance.
Apr 11 17:13:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Detach interface failed, port_id=fe9d8f85-8c07-4fef-ac72-417df1310bd3, reason: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Acquiring lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] No waiting events found dispatching network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:13 user nova-compute[71063]: WARNING nova.compute.manager [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Received unexpected event network-vif-plugged-fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance with vm_state active and task_state deleting.
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:13 user nova-compute[71063]: INFO nova.compute.manager [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Took 0.98 seconds to detach 1 volumes for instance.
Apr 11 17:13:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Deleting volume: fbbb37a6-c422-4ef3-98c9-e208a1934805 {{(pid=71063) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 17:13:13 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:13 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:13 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=26.33746337890625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Applying migration context for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a as it has an incoming, in-progress migration 6cfd4117-0912-4615-8309-f7b12d6791d0. Migration status is finished {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 17:13:14 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating resource usage from migration 6cfd4117-0912-4615-8309-f7b12d6791d0
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9efebdaa-288e-42f5-af7d-ca64963be57a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance dba29188-c963-44d4-95fa-09bffbcb8dca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Migration 6cfd4117-0912-4615-8309-f7b12d6791d0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 821c0f5c-2011-443d-9455-49cc9e317e33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.420s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:13:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:14 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Deleted allocations for instance dba29188-c963-44d4-95fa-09bffbcb8dca
Apr 11 17:13:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "dba29188-c963-44d4-95fa-09bffbcb8dca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.153s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233191.6428947, dba29188-c963-44d4-95fa-09bffbcb8dca => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] VM Stopped (Lifecycle Event)
Apr 11 17:13:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8793c27e-0986-4a30-8e18-0a227938c76a None None] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:27 user nova-compute[71063]: INFO nova.compute.manager [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Terminating instance
Apr 11 17:13:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Instance destroyed successfully.
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'resources' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T17:10:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1021636219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1021636219',id=22,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg==',key_name='tempest-keypair-1138093427',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec2d39b4dbd0440c93734b0bab463b11',ramdisk_id='',reservation_id='r-i4i0juwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1294682350',owner_user_name='tempest-TaggedAttachmentsTest-1294682350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a78f1b0eaee488f89af2d7d82cd9e08',uuid=9efebdaa-288e-42f5-af7d-ca64963be57a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converting VIF {"id": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "address": "fa:16:3e:6a:66:a9", "network": {"id": "a52cb4ad-0152-403f-97c9-ea2bd1366b97", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1780448552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec2d39b4dbd0440c93734b0bab463b11", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5605470-20", "ovs_interfaceid": "d5605470-2058-46dd-bc30-a8f0ba8c82db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG os_vif [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5605470-20, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:28 user nova-compute[71063]: INFO os_vif [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:66:a9,bridge_name='br-int',has_traffic_filtering=True,id=d5605470-2058-46dd-bc30-a8f0ba8c82db,network=Network(a52cb4ad-0152-403f-97c9-ea2bd1366b97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5605470-20')
Apr 11 17:13:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Deleting instance files /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a_del
Apr 11 17:13:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Deletion of /opt/stack/data/nova/instances/9efebdaa-288e-42f5-af7d-ca64963be57a_del complete
Apr 11 17:13:28 user nova-compute[71063]: INFO nova.compute.manager [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 11 17:13:28 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:13:28 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing instance network info cache due to event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:29 user nova-compute[71063]: INFO nova.compute.manager [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Attaching volume c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 to /dev/vdb
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63515a72-7d22-492e-aef6-493ca1fa718e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932fc60-6d2a-468b-954c-d60480b619e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d79359-f764-46d7-b228-ca1311681d2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da1290a-3112-46e5-86de-9b4b588eaa0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:13:29 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Took 1.13 seconds to deallocate network for instance.
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-deleted-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:13:29 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:13:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[312e72ee-db10-4dd0-93e6-a8a7d1bea48f]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:29 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating existing volume attachment record: 88dd3b7e-eea3-47e9-b0f5-01719f04d1d2 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:30 user nova-compute[71063]: WARNING nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state deleted and task_state None.
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:30 user nova-compute[71063]: WARNING nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state deleted and task_state None.
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:30 user nova-compute[71063]: WARNING nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state deleted and task_state None.
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:30 user nova-compute[71063]: WARNING nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-unplugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state deleted and task_state None.
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] No waiting events found dispatching network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:30 user nova-compute[71063]: WARNING nova.compute.manager [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Received unexpected event network-vif-plugged-d5605470-2058-46dd-bc30-a8f0ba8c82db for instance with vm_state deleted and task_state None.
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.network.neutron [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updated VIF entry in instance network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.network.neutron [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.391s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:30 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Deleted allocations for instance 9efebdaa-288e-42f5-af7d-ca64963be57a
Apr 11 17:13:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "9efebdaa-288e-42f5-af7d-ca64963be57a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLZqrAtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:34 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[41875468-2c26-40b6-ad91-921ca9ca5cea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:13:34 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[006fb7ae-6245-40d9-92f8-12511f8d8cc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6] added
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e41525-148e-4e30-927f-dca3e49b2b2a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a51eee-a5c2-48f2-b71d-a08464821539]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLZqrAtU {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sLZqrAtU" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4e480e-1641-442f-9319-341024c01a5f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sLZqrAtU'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c035064-e471-41d1-9fe9-c3d0c00203de]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fbd964-2b68-40c4-82c5-06d405faf326]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc534f43-dc2c-4af6-ba4f-bde440501dcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260]
Apr 11 17:13:34 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260] successful.
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e09f42-d073-4617-93a8-786fd1a67023]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c99bfb-938f-46b3-9f7a-7cd92f493007]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[162cb4d2-1b8f-4967-bb5c-1c74a771490a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:13:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLZqrAtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:13:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23566376133653136', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566376133653136', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:13:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:13:35 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:13:35 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:13:35 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:13:35 user nova-compute[71063]:   <serial>c1f959e0-9f24-4e52-b2d6-b756bc69d2e6</serial>
Apr 11 17:13:35 user nova-compute[71063]: </disk>
Apr 11 17:13:35 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:13:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:13:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:13:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:f6:6e:38, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:13:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.574s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:37 user nova-compute[71063]: INFO nova.compute.manager [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] instance snapshotting
Apr 11 17:13:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Beginning live snapshot process
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:37 user nova-compute[71063]: INFO nova.compute.manager [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Rescuing
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json -f qcow2" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json -f qcow2 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f.delta 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f.delta 1073741824" returned: 0 in 0.061s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 17:13:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:38 user nova-compute[71063]: WARNING nova.compute.manager [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state active and task_state rescuing.
Apr 11 17:13:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance destroyed successfully.
Apr 11 17:13:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Attempting rescue
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:13:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Creating image(s)
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71063) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 17:13:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f.delta /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue" returned: 0 in 0.075s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'migration_context' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start _get_guest_xml network_info=[{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:f6:6e:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:39 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579308500',display_name='tempest-ServerRescueNegativeTestJSON-server-579308500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579308500',id=24,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGkKTLlyaiNlgTA/a3+wQJKjlfUlqxOhcZof+ak5elUWRWmgYc/CbiNKCyQuPLIMAq91lRafTJCTDR90vug4Xdnzc+pbfBDvuS8gBnQ8lxmDuXBq11y3jCZxiBHnPd13g==',key_name='tempest-keypair-896312461',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:11:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-5q306noz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3666d19053684843b400aab6ebf29cce',uuid=9e213b9c-23c4-4fe4-bd2f-2443ee3628bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:f6:6e:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "vif_mac": "fa:16:3e:f6:6e:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:13:39 user nova-compute[71063]:   <uuid>9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</uuid>
Apr 11 17:13:39 user nova-compute[71063]:   <name>instance-00000018</name>
Apr 11 17:13:39 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:13:39 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:13:39 user nova-compute[71063]:   <metadata>
Apr 11 17:13:39 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:13:39 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-579308500</nova:name>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:13:39</nova:creationTime>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:13:39 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:13:39 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:owner>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:user uuid="3666d19053684843b400aab6ebf29cce">tempest-ServerRescueNegativeTestJSON-1553918933-project-member</nova:user>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:project uuid="16e55c9209ac4b11b5af5ec1ad14d8b5">tempest-ServerRescueNegativeTestJSON-1553918933</nova:project>
Apr 11 17:13:39 user nova-compute[71063]:       </nova:owner>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:13:39 user nova-compute[71063]:       <nova:ports>
Apr 11 17:13:39 user nova-compute[71063]:         <nova:port uuid="b9d61f36-ee8c-4487-81e1-28d27592a092">
Apr 11 17:13:39 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:13:39 user nova-compute[71063]:         </nova:port>
Apr 11 17:13:39 user nova-compute[71063]:       </nova:ports>
Apr 11 17:13:39 user nova-compute[71063]:     </nova:instance>
Apr 11 17:13:39 user nova-compute[71063]:   </metadata>
Apr 11 17:13:39 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:13:39 user nova-compute[71063]:     <system>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="serial">9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</entry>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="uuid">9e213b9c-23c4-4fe4-bd2f-2443ee3628bc</entry>
Apr 11 17:13:39 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:13:39 user nova-compute[71063]:     </system>
Apr 11 17:13:39 user nova-compute[71063]:   </sysinfo>
Apr 11 17:13:39 user nova-compute[71063]:   <os>
Apr 11 17:13:39 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:13:39 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:13:39 user nova-compute[71063]:   </os>
Apr 11 17:13:39 user nova-compute[71063]:   <features>
Apr 11 17:13:39 user nova-compute[71063]:     <acpi/>
Apr 11 17:13:39 user nova-compute[71063]:     <apic/>
Apr 11 17:13:39 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:13:39 user nova-compute[71063]:   </features>
Apr 11 17:13:39 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:13:39 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:13:39 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:13:39 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:13:39 user nova-compute[71063]:   </clock>
Apr 11 17:13:39 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:13:39 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:13:39 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:13:39 user nova-compute[71063]:   </cpu>
Apr 11 17:13:39 user nova-compute[71063]:   <devices>
Apr 11 17:13:39 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:13:39 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:13:39 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue"/>
Apr 11 17:13:39 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:13:39 user nova-compute[71063]:     </disk>
Apr 11 17:13:39 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:13:39 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:13:39 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk"/>
Apr 11 17:13:39 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:13:39 user nova-compute[71063]:     </disk>
Apr 11 17:13:39 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:13:39 user nova-compute[71063]:       <mac address="fa:16:3e:f6:6e:38"/>
Apr 11 17:13:39 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:39 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:13:39 user nova-compute[71063]:       <target dev="tapb9d61f36-ee"/>
Apr 11 17:13:39 user nova-compute[71063]:     </interface>
Apr 11 17:13:39 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:13:39 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/console.log" append="off"/>
Apr 11 17:13:39 user nova-compute[71063]:     </serial>
Apr 11 17:13:39 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:13:39 user nova-compute[71063]:     <video>
Apr 11 17:13:39 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:39 user nova-compute[71063]:     </video>
Apr 11 17:13:39 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:13:39 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:13:39 user nova-compute[71063]:     </rng>
Apr 11 17:13:39 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:13:39 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:13:39 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:13:39 user nova-compute[71063]:     </memballoon>
Apr 11 17:13:39 user nova-compute[71063]:   </devices>
Apr 11 17:13:39 user nova-compute[71063]: </domain>
Apr 11 17:13:39 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:13:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance destroyed successfully.
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] No VIF found with MAC fa:16:3e:f6:6e:38, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f.delta /opt/stack/data/nova/instances/snapshots/tmp3b16e4ci/56fd148000b94e0393d9174ad531230f" returned: 0 in 0.701s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Snapshot extracted, beginning image upload
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:13:40 user nova-compute[71063]: INFO nova.compute.claims [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Claim successful on node user
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:40 user nova-compute[71063]: WARNING nova.compute.manager [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state active and task_state rescuing.
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:13:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.policy [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:13:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Creating image(s)
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "/opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "/opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "/opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.184s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk 1073741824" returned: 0 in 0.066s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.174s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Cannot resize image /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'migration_context' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Ensure instance console log exists: /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:42 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Snapshot image upload complete
Apr 11 17:13:42 user nova-compute[71063]: INFO nova.compute.manager [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Took 5.47 seconds to snapshot the instance on the hypervisor.
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:42 user nova-compute[71063]: WARNING nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state active and task_state rescuing.
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:42 user nova-compute[71063]: WARNING nova.compute.manager [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state active and task_state rescuing.
Apr 11 17:13:42 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Successfully created port: 468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233208.6640081, 9efebdaa-288e-42f5-af7d-ca64963be57a => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:43 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] VM Stopped (Lifecycle Event)
Apr 11 17:13:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-762d20f9-1e6b-4833-971d-eda6b085dd07 None None] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233223.8074014, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Resumed (Lifecycle Event)
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Successfully updated port: 468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:13:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233223.808577, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Started (Lifecycle Event)
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-changed-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Refreshing instance network info cache due to event network-changed-468963af-7fdf-43f9-9be8-b1569345361e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Acquiring lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Acquired lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.network.neutron [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Refreshing network info cache for port 468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Releasing lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquired lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating instance_info_cache with network_info: [{"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Releasing lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance network_info: |[{"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Start _get_guest_xml network_info=[{"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:13:44 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:44 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673575885',display_name='tempest-AttachVolumeTestJSON-server-1673575885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673575885',id=27,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLGA7ITRVNn7GjLSzkVsG9qllpiTLCnVwtVaAGuq9WnIK8VQYMWagqSqLSEUWmmtBFT/JnilDnpp1MRrDJ/InQ4R18JevW4oC7hjIRIQnHR5O9JyvqVM7iBsqyLgBUo4A==',key_name='tempest-keypair-1520901621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-x7wv0myk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=771531ad-b1f4-486a-b70f-f46837df58b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'pci_devices' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:13:44 user nova-compute[71063]:   <uuid>771531ad-b1f4-486a-b70f-f46837df58b5</uuid>
Apr 11 17:13:44 user nova-compute[71063]:   <name>instance-0000001b</name>
Apr 11 17:13:44 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:13:44 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:13:44 user nova-compute[71063]:   <metadata>
Apr 11 17:13:44 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:13:44 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeTestJSON-server-1673575885</nova:name>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:13:44</nova:creationTime>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:13:44 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:13:44 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:owner>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:user uuid="ac0109eab2dc45fe824a03e2d09fa022">tempest-AttachVolumeTestJSON-1071232138-project-member</nova:user>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:project uuid="3c902eb30be24cc6bd26c0ab7036d037">tempest-AttachVolumeTestJSON-1071232138</nova:project>
Apr 11 17:13:44 user nova-compute[71063]:       </nova:owner>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:13:44 user nova-compute[71063]:       <nova:ports>
Apr 11 17:13:44 user nova-compute[71063]:         <nova:port uuid="468963af-7fdf-43f9-9be8-b1569345361e">
Apr 11 17:13:44 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:13:44 user nova-compute[71063]:         </nova:port>
Apr 11 17:13:44 user nova-compute[71063]:       </nova:ports>
Apr 11 17:13:44 user nova-compute[71063]:     </nova:instance>
Apr 11 17:13:44 user nova-compute[71063]:   </metadata>
Apr 11 17:13:44 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:13:44 user nova-compute[71063]:     <system>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="serial">771531ad-b1f4-486a-b70f-f46837df58b5</entry>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="uuid">771531ad-b1f4-486a-b70f-f46837df58b5</entry>
Apr 11 17:13:44 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:13:44 user nova-compute[71063]:     </system>
Apr 11 17:13:44 user nova-compute[71063]:   </sysinfo>
Apr 11 17:13:44 user nova-compute[71063]:   <os>
Apr 11 17:13:44 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:13:44 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:13:44 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:13:44 user nova-compute[71063]:   </os>
Apr 11 17:13:44 user nova-compute[71063]:   <features>
Apr 11 17:13:44 user nova-compute[71063]:     <acpi/>
Apr 11 17:13:44 user nova-compute[71063]:     <apic/>
Apr 11 17:13:44 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:13:44 user nova-compute[71063]:   </features>
Apr 11 17:13:44 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:13:44 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:13:44 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:13:44 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:13:44 user nova-compute[71063]:   </clock>
Apr 11 17:13:44 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:13:44 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:13:44 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:13:44 user nova-compute[71063]:   </cpu>
Apr 11 17:13:44 user nova-compute[71063]:   <devices>
Apr 11 17:13:44 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:13:44 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:13:44 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk"/>
Apr 11 17:13:44 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:13:44 user nova-compute[71063]:     </disk>
Apr 11 17:13:44 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:13:44 user nova-compute[71063]:       <mac address="fa:16:3e:3e:94:61"/>
Apr 11 17:13:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:44 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:13:44 user nova-compute[71063]:       <target dev="tap468963af-7f"/>
Apr 11 17:13:44 user nova-compute[71063]:     </interface>
Apr 11 17:13:44 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:13:44 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/console.log" append="off"/>
Apr 11 17:13:44 user nova-compute[71063]:     </serial>
Apr 11 17:13:44 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:13:44 user nova-compute[71063]:     <video>
Apr 11 17:13:44 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:44 user nova-compute[71063]:     </video>
Apr 11 17:13:44 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:13:44 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:13:44 user nova-compute[71063]:     </rng>
Apr 11 17:13:44 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:13:44 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:13:44 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:13:44 user nova-compute[71063]:     </memballoon>
Apr 11 17:13:44 user nova-compute[71063]:   </devices>
Apr 11 17:13:44 user nova-compute[71063]: </domain>
Apr 11 17:13:44 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673575885',display_name='tempest-AttachVolumeTestJSON-server-1673575885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673575885',id=27,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLGA7ITRVNn7GjLSzkVsG9qllpiTLCnVwtVaAGuq9WnIK8VQYMWagqSqLSEUWmmtBFT/JnilDnpp1MRrDJ/InQ4R18JevW4oC7hjIRIQnHR5O9JyvqVM7iBsqyLgBUo4A==',key_name='tempest-keypair-1520901621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-x7wv0myk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=771531ad-b1f4-486a-b70f-f46837df58b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG os_vif [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap468963af-7f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap468963af-7f, col_values=(('external_ids', {'iface-id': '468963af-7fdf-43f9-9be8-b1569345361e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:94:61', 'vm-uuid': '771531ad-b1f4-486a-b70f-f46837df58b5'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:44 user nova-compute[71063]: INFO os_vif [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f')
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:13:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No VIF found with MAC fa:16:3e:3e:94:61, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] No waiting events found dispatching network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:46 user nova-compute[71063]: WARNING nova.compute.manager [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received unexpected event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e for instance with vm_state building and task_state spawning.
Apr 11 17:13:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233228.6236472, 771531ad-b1f4-486a-b70f-f46837df58b5 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] VM Resumed (Lifecycle Event)
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance spawned successfully.
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Port 6b20a003-d501-4958-9c8c-567343698e97 binding to destination host user is already ACTIVE {{(pid=71063) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233228.624775, 771531ad-b1f4-486a-b70f-f46837df58b5 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] VM Started (Lifecycle Event)
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] No waiting events found dispatching network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:48 user nova-compute[71063]: WARNING nova.compute.manager [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received unexpected event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e for instance with vm_state building and task_state spawning.
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Took 7.36 seconds to spawn the instance on the hypervisor.
Apr 11 17:13:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:13:48 user nova-compute[71063]: INFO nova.compute.manager [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Took 8.30 seconds to build instance.
Apr 11 17:13:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.399s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Creating tmpfile /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/tmpu3v7dgds to verify with other compute node that the instance is on the same shared storage. {{(pid=71063) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:49 user nova-compute[71063]: WARNING nova.compute.manager [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state resized and task_state resize_reverting.
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:50 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance destroyed successfully.
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.objects.instance [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:12:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b20a003-d5, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:13:50 user nova-compute[71063]: INFO os_vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:50 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b2899a-4251-4efe-bfe3-5e68e11df616]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:13:50 user nova-compute[71063]: No targets found.
Apr 11 17:13:50 user nova-compute[71063]: iSNS:
Apr 11 17:13:50 user nova-compute[71063]: No targets found.
Apr 11 17:13:50 user nova-compute[71063]: STATIC:
Apr 11 17:13:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:13:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:13:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8
Apr 11 17:13:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:13:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:13:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:13:50 user nova-compute[71063]: FIRMWARE:
Apr 11 17:13:50 user nova-compute[71063]: No targets found.
Apr 11 17:13:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:13:50 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:13:50 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9173be-fc4a-46d3-8295-e4fe4ebcee24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73724d-0a49-44b0-a380-1075f5ba517d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe804017e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[839fb189-bb6d-4e93-982f-25d56f288006]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc6e35-cb7d-408d-9e83-d7ffc8b6a127]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e1653f-e24f-4328-9057-7e1631532d17]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c5cec-cea0-4aa6-96a5-02e59e90245b]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a14ed-6728-4bc3-ae6b-d09a4afe2101]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b68d9-90f6-40bd-b7cb-867e5ecfa904]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:13:50 user nova-compute[71063]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:13:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bda857-027c-440c-9c00-8b467802b7c3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (336ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG nova.objects.instance [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'migration_context' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:13:51 user nova-compute[71063]: WARNING nova.compute.manager [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state resized and task_state resize_reverting.
Apr 11 17:13:51 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:13:52 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:13:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.504s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:13:52 user nova-compute[71063]: INFO nova.compute.manager [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Swapping old allocation on dict_keys(['5e60710e-bd05-42a7-9d8e-dda73c9154fd']) held by migration 6cfd4117-0912-4615-8309-f7b12d6791d0 for instance
Apr 11 17:13:52 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Overwriting current allocation {'allocations': {'5e60710e-bd05-42a7-9d8e-dda73c9154fd': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 32}}, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'consumer_generation': 1} on consumer 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 17:13:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:13:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:13:52 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.utils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97317b6-4810-4df6-bdc6-33e86d362a54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c8ddd-1696-401b-8871-5fc7b99ae8ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2e50b0-a5be-4b0c-9d38-66a6592406b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4eb3ad-cf36-4fe1-9e56-5147a7bb1ea0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:13:53 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:13:53 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d992db-e462-491f-af6a-4cb52c7660d1]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG os_brick.utils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:54 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:13:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:13:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Starting finish_revert_migration {{(pid=71063) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start _get_guest_xml network_info=[{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': '0946c2da-f492-4f15-8808-17188ff91de3', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1fc7677c-cbd9-48e7-be62-2210074bc87a', 'attached_at': '2023-04-11T17:13:58.000000', 'detached_at': '', 'volume_id': 'c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'serial': 'c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:13:57 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:57 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.objects.instance [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:13:57 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:57 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:13:57 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf76e3-baf9-4508-b86e-d2792a33830d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:13:57 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[40973d70-4dec-4b26-8685-f38eebdffbce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4] added
Apr 11 17:13:57 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.123s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa756ca-ee39-4a87-b153-c664d3dc7d2d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1a05ea-c1f8-441d-a7f7-58ddeb933fad]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xpPIoVje" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97114e0-eb4f-46a3-a16c-3a8ec83b6f3d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xpPIoVje'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4229b455-ea14-43f9-b463-31f40fd0f446]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bb4f1e-5735-4e61-bba1-c33f8efbae01]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e6621a-92da-4abc-9389-e1f06781eade]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:13:58 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:13:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5035f7-15f5-48e7-a782-54f64b9e50c1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9337dd37-ca34-4545-af1e-7ddd5163a651]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:13:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d762a7b6-93bd-445d-a960-3e351d7bbc82]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:13:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264653030363136', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:13:59 user nova-compute[71063]:   <uuid>1fc7677c-cbd9-48e7-be62-2210074bc87a</uuid>
Apr 11 17:13:59 user nova-compute[71063]:   <name>instance-00000004</name>
Apr 11 17:13:59 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:13:59 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:13:59 user nova-compute[71063]:   <metadata>
Apr 11 17:13:59 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:13:59 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-745930106</nova:name>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:13:57</nova:creationTime>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:13:59 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:13:59 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:owner>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:13:59 user nova-compute[71063]:       </nova:owner>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:13:59 user nova-compute[71063]:       <nova:ports>
Apr 11 17:13:59 user nova-compute[71063]:         <nova:port uuid="6b20a003-d501-4958-9c8c-567343698e97">
Apr 11 17:13:59 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 17:13:59 user nova-compute[71063]:         </nova:port>
Apr 11 17:13:59 user nova-compute[71063]:       </nova:ports>
Apr 11 17:13:59 user nova-compute[71063]:     </nova:instance>
Apr 11 17:13:59 user nova-compute[71063]:   </metadata>
Apr 11 17:13:59 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:13:59 user nova-compute[71063]:     <system>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="serial">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="uuid">1fc7677c-cbd9-48e7-be62-2210074bc87a</entry>
Apr 11 17:13:59 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:13:59 user nova-compute[71063]:     </system>
Apr 11 17:13:59 user nova-compute[71063]:   </sysinfo>
Apr 11 17:13:59 user nova-compute[71063]:   <os>
Apr 11 17:13:59 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:13:59 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:13:59 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:13:59 user nova-compute[71063]:   </os>
Apr 11 17:13:59 user nova-compute[71063]:   <features>
Apr 11 17:13:59 user nova-compute[71063]:     <acpi/>
Apr 11 17:13:59 user nova-compute[71063]:     <apic/>
Apr 11 17:13:59 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:13:59 user nova-compute[71063]:   </features>
Apr 11 17:13:59 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:13:59 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:13:59 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:13:59 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:13:59 user nova-compute[71063]:   </clock>
Apr 11 17:13:59 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:13:59 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:13:59 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:13:59 user nova-compute[71063]:   </cpu>
Apr 11 17:13:59 user nova-compute[71063]:   <devices>
Apr 11 17:13:59 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:13:59 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:13:59 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk"/>
Apr 11 17:13:59 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:13:59 user nova-compute[71063]:     </disk>
Apr 11 17:13:59 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:13:59 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:13:59 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:13:59 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:13:59 user nova-compute[71063]:       <serial>c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4</serial>
Apr 11 17:13:59 user nova-compute[71063]:     </disk>
Apr 11 17:13:59 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:13:59 user nova-compute[71063]:       <mac address="fa:16:3e:6d:79:2f"/>
Apr 11 17:13:59 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:59 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:13:59 user nova-compute[71063]:       <target dev="tap6b20a003-d5"/>
Apr 11 17:13:59 user nova-compute[71063]:     </interface>
Apr 11 17:13:59 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:13:59 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/console.log" append="off"/>
Apr 11 17:13:59 user nova-compute[71063]:     </serial>
Apr 11 17:13:59 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:13:59 user nova-compute[71063]:     <video>
Apr 11 17:13:59 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:13:59 user nova-compute[71063]:     </video>
Apr 11 17:13:59 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:13:59 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:13:59 user nova-compute[71063]:     </rng>
Apr 11 17:13:59 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:13:59 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:13:59 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:13:59 user nova-compute[71063]:     </memballoon>
Apr 11 17:13:59 user nova-compute[71063]:   </devices>
Apr 11 17:13:59 user nova-compute[71063]: </domain>
Apr 11 17:13:59 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:12:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG os_vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b20a003-d5, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b20a003-d5, col_values=(('external_ids', {'iface-id': '6b20a003-d501-4958-9c8c-567343698e97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:79:2f', 'vm-uuid': '1fc7677c-cbd9-48e7-be62-2210074bc87a'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:13:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:13:59 user nova-compute[71063]: INFO os_vif [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:14:00 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:01 user nova-compute[71063]: WARNING nova.compute.manager [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state resized and task_state resize_reverting.
Apr 11 17:14:01 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:02 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:14:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 1fc7677c-cbd9-48e7-be62-2210074bc87a due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233243.1766968, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Resumed (Lifecycle Event)
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance running successfully.
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] finish_revert_migration finished successfully. {{(pid=71063) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:03 user nova-compute[71063]: WARNING nova.compute.manager [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state resized and task_state resize_reverting.
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233243.1782916, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Started (Lifecycle Event)
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 17:14:03 user nova-compute[71063]: INFO nova.compute.manager [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance to original state: 'active'
Apr 11 17:14:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:05 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:14:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:12 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:14:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:14 user nova-compute[71063]: INFO nova.compute.manager [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Terminating instance
Apr 11 17:14:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-unplugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] No waiting events found dispatching network-vif-unplugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-unplugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:14:16 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:16 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=26.28818130493164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:16 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Instance destroyed successfully.
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid 821c0f5c-2011-443d-9455-49cc9e317e33 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:12:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735547101',display_name='tempest-TestVolumeBootPattern-server-1735547101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735547101',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r248ga5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:12:42Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=821c0f5c-2011-443d-9455-49cc9e317e33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "address": "fa:16:3e:90:08:df", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed86986-3e", "ovs_interfaceid": "5ed86986-3eff-4f85-83ed-3db9257c5ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_vif [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed86986-3e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:14:16 user nova-compute[71063]: INFO os_vif [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:08:df,bridge_name='br-int',has_traffic_filtering=True,id=5ed86986-3eff-4f85-83ed-3db9257c5ec9,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed86986-3e')
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuhZagke', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:14:16 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f4e995-d9cd-441a-a5c4-2f17b03c71f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:14:16 user nova-compute[71063]: No targets found.
Apr 11 17:14:16 user nova-compute[71063]: iSNS:
Apr 11 17:14:16 user nova-compute[71063]: No targets found.
Apr 11 17:14:16 user nova-compute[71063]: STATIC:
Apr 11 17:14:16 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:14:16 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:14:16 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:14:16 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:14:16 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:14:16 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:14:16 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8
Apr 11 17:14:16 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:14:16 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:14:16 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:14:16 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:14:16 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:14:16 user nova-compute[71063]: FIRMWARE:
Apr 11 17:14:16 user nova-compute[71063]: No targets found.
Apr 11 17:14:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:14:16 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:14:16 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab9170-a6fc-4486-895d-8e6f3fd54f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98a1479-63f8-45bf-846b-8811a81a869d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec1633490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba8a43-0196-4824-803a-e48604b92294]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd93cf46-f04a-4837-a3f8-047f723378df]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d194e66-a1af-41af-80de-c604de31721d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f33821-ae83-4812-bb42-f84344903a0c]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 821c0f5c-2011-443d-9455-49cc9e317e33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 771531ad-b1f4-486a-b70f-f46837df58b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e240c58-5043-4087-b37d-3ad7af09454d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a75da-0c42-469b-9306-e466dc91f49c]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260]
Apr 11 17:14:16 user nova-compute[71063]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8, portal: 172.16.0.220,3260] successful.
Apr 11 17:14:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e3356-0f81-4012-8f9a-90b5b4b988aa]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (362ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:14:16 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Deleting instance files /opt/stack/data/nova/instances/821c0f5c-2011-443d-9455-49cc9e317e33_del
Apr 11 17:14:16 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Deletion of /opt/stack/data/nova/instances/821c0f5c-2011-443d-9455-49cc9e317e33_del complete
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:14:16 user nova-compute[71063]: INFO nova.compute.manager [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Took 1.65 seconds to destroy the instance on the hypervisor.
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:14:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.760s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Acquiring lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Lock "821c0f5c-2011-443d-9455-49cc9e317e33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] No waiting events found dispatching network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:17 user nova-compute[71063]: WARNING nova.compute.manager [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received unexpected event network-vif-plugged-5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance with vm_state active and task_state deleting.
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:17 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Took 1.05 seconds to deallocate network for instance.
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Received event network-vif-deleted-5ed86986-3eff-4f85-83ed-3db9257c5ec9 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:17 user nova-compute[71063]: INFO nova.compute.manager [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Neutron deleted interface 5ed86986-3eff-4f85-83ed-3db9257c5ec9; detaching it from the instance and deleting it from the info cache
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Detach interface failed, port_id=5ed86986-3eff-4f85-83ed-3db9257c5ec9, reason: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:14:18 user nova-compute[71063]: INFO nova.compute.manager [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 17:14:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Deleting volume: 88fbc7ce-cc86-48d1-95e4-aefcc3337ea8 {{(pid=71063) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:14:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:19 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance 821c0f5c-2011-443d-9455-49cc9e317e33
Apr 11 17:14:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "821c0f5c-2011-443d-9455-49cc9e317e33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.129s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:31 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233255.7265625, 821c0f5c-2011-443d-9455-49cc9e317e33 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:14:31 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] VM Stopped (Lifecycle Event)
Apr 11 17:14:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-939efd52-96bd-44b9-b9d7-d49e92a012a3 None None] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:14:37 user nova-compute[71063]: INFO nova.compute.claims [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Claim successful on node user
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:14:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:14:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Creating image(s)
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.policy [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk 1073741824" returned: 0 in 0.055s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.127s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:14:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Cannot resize image /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'migration_context' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Ensure instance console log exists: /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Successfully created port: 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Successfully updated port: 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:14:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing instance network info cache due to event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance network_info: |[{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start _get_guest_xml network_info=[{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:14:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFqFHOn8aPRX0q5MSRPMTTacpD4HYx1m4dQ1XGm7PdPNjP6f9xXOv0GIXZGtAqKHrXu3xeE1uYxfyAMROxwbD8IK2W1cFmzOptY72oYUTM7AtAciDDzgNoF5MkpmQhYKg==',key_name='tempest-keypair-385713192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_devices' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:14:40 user nova-compute[71063]:   <uuid>49e044ae-91af-4db8-b0fe-3679dd210ab2</uuid>
Apr 11 17:14:40 user nova-compute[71063]:   <name>instance-0000001c</name>
Apr 11 17:14:40 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:14:40 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:14:40 user nova-compute[71063]:   <metadata>
Apr 11 17:14:40 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:14:40 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2104871241</nova:name>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:14:40</nova:creationTime>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:14:40 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:14:40 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:owner>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:user uuid="b69069a1461d485598e2078cc12772a5">tempest-AttachVolumeShelveTestJSON-2051096798-project-member</nova:user>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:project uuid="fce268052b8046e5a7efa41048e96645">tempest-AttachVolumeShelveTestJSON-2051096798</nova:project>
Apr 11 17:14:40 user nova-compute[71063]:       </nova:owner>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:14:40 user nova-compute[71063]:       <nova:ports>
Apr 11 17:14:40 user nova-compute[71063]:         <nova:port uuid="4d7d89bc-13fc-41ae-b35c-618cc375d3b4">
Apr 11 17:14:40 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:14:40 user nova-compute[71063]:         </nova:port>
Apr 11 17:14:40 user nova-compute[71063]:       </nova:ports>
Apr 11 17:14:40 user nova-compute[71063]:     </nova:instance>
Apr 11 17:14:40 user nova-compute[71063]:   </metadata>
Apr 11 17:14:40 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:14:40 user nova-compute[71063]:     <system>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="serial">49e044ae-91af-4db8-b0fe-3679dd210ab2</entry>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="uuid">49e044ae-91af-4db8-b0fe-3679dd210ab2</entry>
Apr 11 17:14:40 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:14:40 user nova-compute[71063]:     </system>
Apr 11 17:14:40 user nova-compute[71063]:   </sysinfo>
Apr 11 17:14:40 user nova-compute[71063]:   <os>
Apr 11 17:14:40 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:14:40 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:14:40 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:14:40 user nova-compute[71063]:   </os>
Apr 11 17:14:40 user nova-compute[71063]:   <features>
Apr 11 17:14:40 user nova-compute[71063]:     <acpi/>
Apr 11 17:14:40 user nova-compute[71063]:     <apic/>
Apr 11 17:14:40 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:14:40 user nova-compute[71063]:   </features>
Apr 11 17:14:40 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:14:40 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:14:40 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:14:40 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:14:40 user nova-compute[71063]:   </clock>
Apr 11 17:14:40 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:14:40 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:14:40 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:14:40 user nova-compute[71063]:   </cpu>
Apr 11 17:14:40 user nova-compute[71063]:   <devices>
Apr 11 17:14:40 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:14:40 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:14:40 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk"/>
Apr 11 17:14:40 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:14:40 user nova-compute[71063]:     </disk>
Apr 11 17:14:40 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:14:40 user nova-compute[71063]:       <mac address="fa:16:3e:35:10:e5"/>
Apr 11 17:14:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:14:40 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:14:40 user nova-compute[71063]:       <target dev="tap4d7d89bc-13"/>
Apr 11 17:14:40 user nova-compute[71063]:     </interface>
Apr 11 17:14:40 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:14:40 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/console.log" append="off"/>
Apr 11 17:14:40 user nova-compute[71063]:     </serial>
Apr 11 17:14:40 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:14:40 user nova-compute[71063]:     <video>
Apr 11 17:14:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:14:40 user nova-compute[71063]:     </video>
Apr 11 17:14:40 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:14:40 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:14:40 user nova-compute[71063]:     </rng>
Apr 11 17:14:40 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:14:40 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:14:40 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:14:40 user nova-compute[71063]:     </memballoon>
Apr 11 17:14:40 user nova-compute[71063]:   </devices>
Apr 11 17:14:40 user nova-compute[71063]: </domain>
Apr 11 17:14:40 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFqFHOn8aPRX0q5MSRPMTTacpD4HYx1m4dQ1XGm7PdPNjP6f9xXOv0GIXZGtAqKHrXu3xeE1uYxfyAMROxwbD8IK2W1cFmzOptY72oYUTM7AtAciDDzgNoF5MkpmQhYKg==',key_name='tempest-keypair-385713192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:14:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG os_vif [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d7d89bc-13, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d7d89bc-13, col_values=(('external_ids', {'iface-id': '4d7d89bc-13fc-41ae-b35c-618cc375d3b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:10:e5', 'vm-uuid': '49e044ae-91af-4db8-b0fe-3679dd210ab2'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:40 user nova-compute[71063]: INFO os_vif [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13')
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No VIF found with MAC fa:16:3e:35:10:e5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updated VIF entry in instance network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:14:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:42 user nova-compute[71063]: WARNING nova.compute.manager [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state building and task_state spawning.
Apr 11 17:14:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233283.880794, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:14:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Resumed (Lifecycle Event)
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:14:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance spawned successfully.
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:14:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233283.8826854, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:14:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Started (Lifecycle Event)
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:14:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:14:44 user nova-compute[71063]: INFO nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 11 17:14:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:14:44 user nova-compute[71063]: INFO nova.compute.manager [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Took 6.36 seconds to build instance.
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.464s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:44 user nova-compute[71063]: WARNING nova.compute.manager [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state active and task_state None.
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:14:44 user nova-compute[71063]: INFO nova.compute.claims [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Claim successful on node user
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:14:45 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:14:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:14:45 user nova-compute[71063]: INFO nova.virt.block_device [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Booting with volume-backed-image ead60aec-ecbe-42c9-a205-fb6fdd4aef73 at /dev/vda
Apr 11 17:14:45 user nova-compute[71063]: DEBUG nova.policy [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:14:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Successfully created port: 7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Successfully updated port: 7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-changed-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Refreshing instance network info cache due to event network-changed-7436f349-9b31-46f1-9866-ad1d71d06e06. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Acquiring lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance network_info: |[{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Acquired lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:14:47 user nova-compute[71063]: DEBUG nova.network.neutron [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Refreshing network info cache for port 7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:14:48 user nova-compute[71063]: DEBUG nova.network.neutron [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updated VIF entry in instance network info cache for port 7436f349-9b31-46f1-9866-ad1d71d06e06. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:14:48 user nova-compute[71063]: DEBUG nova.network.neutron [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:14:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Releasing lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:14:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.utils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75c5a44-9127-42d9-8824-9737c7209c39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206efcd-ef54-440e-99fd-bc43cc2be066]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1c433-a2b3-413f-9abb-cf76dbe40679]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a7f22-211d-4b0d-9b3b-987231d703aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:14:51 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:14:51 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a20e99-38a8-4d57-8309-154756f2a2ff]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG os_brick.utils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:14:51 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating existing volume attachment record: f3c38b21-097e-4ec5-b47d-adf9768f07a5 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:14:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Creating image(s)
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Ensure instance console log exists: /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start _get_guest_xml network_info=[{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'f3c38b21-097e-4ec5-b47d-adf9768f07a5', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'serial': 'e685fee6-6f2e-47b1-9241-988ab7c7ec08'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:14:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:55 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:14:55 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:14:55 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:14:55 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ea7b2-65f4-48e8-9dc1-ed7157fa5a00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:14:55 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a502c9f-9662-4561-b385-8dac31978b50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08] added
Apr 11 17:14:55 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[133bfc55-063c-4002-a7af-0517b9cb12cc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[850dd811-fd4c-49b9-8d50-5441037ee4d7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcFTufSB {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcFTufSB" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aee2a0-0f4c-4433-8e74-6406689598db]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcFTufSB'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1a67f-b9b9-47dc-be83-ee0af11ce7f1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b080559-92a4-4a0f-bb8a-63daadd960f2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:55 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:14:55 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b8b38-8a22-458c-8a5a-5e667b6403cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260]
Apr 11 17:14:56 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260] successful.
Apr 11 17:14:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b3743-76f8-4c63-8ceb-4b104a627138]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a4c383-9617-44ea-8653-b06e8a8074b2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:14:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e9860-5a6f-477f-b02d-3cfb4cf00a05]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:14:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23834303132643930', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834303132643930', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632176154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632176154',id=29,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-nxqs7k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:14:45Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.objects.instance [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:14:57 user nova-compute[71063]:   <uuid>85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</uuid>
Apr 11 17:14:57 user nova-compute[71063]:   <name>instance-0000001d</name>
Apr 11 17:14:57 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:14:57 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:14:57 user nova-compute[71063]:   <metadata>
Apr 11 17:14:57 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:14:57 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1632176154</nova:name>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:14:55</nova:creationTime>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:14:57 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:14:57 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:owner>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:14:57 user nova-compute[71063]:       </nova:owner>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:14:57 user nova-compute[71063]:       <nova:ports>
Apr 11 17:14:57 user nova-compute[71063]:         <nova:port uuid="7436f349-9b31-46f1-9866-ad1d71d06e06">
Apr 11 17:14:57 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:14:57 user nova-compute[71063]:         </nova:port>
Apr 11 17:14:57 user nova-compute[71063]:       </nova:ports>
Apr 11 17:14:57 user nova-compute[71063]:     </nova:instance>
Apr 11 17:14:57 user nova-compute[71063]:   </metadata>
Apr 11 17:14:57 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:14:57 user nova-compute[71063]:     <system>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="serial">85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</entry>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="uuid">85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</entry>
Apr 11 17:14:57 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:14:57 user nova-compute[71063]:     </system>
Apr 11 17:14:57 user nova-compute[71063]:   </sysinfo>
Apr 11 17:14:57 user nova-compute[71063]:   <os>
Apr 11 17:14:57 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:14:57 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:14:57 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:14:57 user nova-compute[71063]:   </os>
Apr 11 17:14:57 user nova-compute[71063]:   <features>
Apr 11 17:14:57 user nova-compute[71063]:     <acpi/>
Apr 11 17:14:57 user nova-compute[71063]:     <apic/>
Apr 11 17:14:57 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:14:57 user nova-compute[71063]:   </features>
Apr 11 17:14:57 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:14:57 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:14:57 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:14:57 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:14:57 user nova-compute[71063]:   </clock>
Apr 11 17:14:57 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:14:57 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:14:57 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:14:57 user nova-compute[71063]:   </cpu>
Apr 11 17:14:57 user nova-compute[71063]:   <devices>
Apr 11 17:14:57 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:14:57 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:14:57 user nova-compute[71063]:       <source dev="/dev/sde"/>
Apr 11 17:14:57 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:14:57 user nova-compute[71063]:       <serial>e685fee6-6f2e-47b1-9241-988ab7c7ec08</serial>
Apr 11 17:14:57 user nova-compute[71063]:     </disk>
Apr 11 17:14:57 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:14:57 user nova-compute[71063]:       <mac address="fa:16:3e:96:7c:6c"/>
Apr 11 17:14:57 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:14:57 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:14:57 user nova-compute[71063]:       <target dev="tap7436f349-9b"/>
Apr 11 17:14:57 user nova-compute[71063]:     </interface>
Apr 11 17:14:57 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:14:57 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/console.log" append="off"/>
Apr 11 17:14:57 user nova-compute[71063]:     </serial>
Apr 11 17:14:57 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:14:57 user nova-compute[71063]:     <video>
Apr 11 17:14:57 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:14:57 user nova-compute[71063]:     </video>
Apr 11 17:14:57 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:14:57 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:14:57 user nova-compute[71063]:     </rng>
Apr 11 17:14:57 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:14:57 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:14:57 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:14:57 user nova-compute[71063]:     </memballoon>
Apr 11 17:14:57 user nova-compute[71063]:   </devices>
Apr 11 17:14:57 user nova-compute[71063]: </domain>
Apr 11 17:14:57 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632176154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632176154',id=29,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-nxqs7k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:14:45Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG os_vif [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7436f349-9b, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7436f349-9b, col_values=(('external_ids', {'iface-id': '7436f349-9b31-46f1-9866-ad1d71d06e06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:7c:6c', 'vm-uuid': '85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:57 user nova-compute[71063]: INFO os_vif [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b')
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:14:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:96:7c:6c, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:14:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:14:58 user nova-compute[71063]: WARNING nova.compute.manager [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state building and task_state spawning.
Apr 11 17:14:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233300.5592244, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Resumed (Lifecycle Event)
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance spawned successfully.
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233300.5594323, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Started (Lifecycle Event)
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:00 user nova-compute[71063]: INFO nova.compute.manager [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Took 15.87 seconds to build instance.
Apr 11 17:15:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.967s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:00 user nova-compute[71063]: WARNING nova.compute.manager [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state None.
Apr 11 17:15:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:15:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:15:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:15:06 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updating instance_info_cache with network_info: [{"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-c5bb4495-9a2d-4903-8158-c57b78e43705" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:15:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:15:10 user nova-compute[71063]: INFO nova.compute.claims [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Claim successful on node user
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:15:10 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:15:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:15:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:15:11 user nova-compute[71063]: INFO nova.virt.block_device [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Booting with volume 2e99e75c-34b5-4135-a5c1-8037e24e601c at /dev/vda
Apr 11 17:15:11 user nova-compute[71063]: DEBUG nova.policy [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.utils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e41ed32-0d2f-412c-9ebc-6de22ce71365]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b785d-44cb-4d82-a482-bba4319eb058]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[64861546-e0f6-46f7-94c2-b8ea061b93d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d591ec5-2771-45c2-8af9-6686a6bc4092]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:11 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:15:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[94298e50-214f-49cd-a536-f4eeec920be3]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG os_brick.utils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Updating existing volume attachment record: 45fa29b8-fc5f-48ab-8bb7-0eff1a554410 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:15:11 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Successfully created port: 11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Successfully updated port: 11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-changed-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Refreshing instance network info cache due to event network-changed-11a50593-74fe-4bfd-adc1-15e1537afc66. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Acquiring lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Updating instance_info_cache with network_info: [{"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Instance network_info: |[{"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Acquired lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:15:12 user nova-compute[71063]: DEBUG nova.network.neutron [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Refreshing network info cache for port 11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:15:13 user nova-compute[71063]: DEBUG nova.network.neutron [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Updated VIF entry in instance network info cache for port 11a50593-74fe-4bfd-adc1-15e1537afc66. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:15:13 user nova-compute[71063]: DEBUG nova.network.neutron [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Updating instance_info_cache with network_info: [{"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Releasing lock "refresh_cache-df974dc8-deda-4bdb-bb9d-1471bee040a7" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:15:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:15:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Creating image(s)
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Ensure instance console log exists: /opt/stack/data/nova/instances/df974dc8-deda-4bdb-bb9d-1471bee040a7/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Start _get_guest_xml network_info=[{"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '45fa29b8-fc5f-48ab-8bb7-0eff1a554410', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGldaLXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df974dc8-deda-4bdb-bb9d-1471bee040a7', 'attached_at': '', 'detached_at': '', 'volume_id': '2e99e75c-34b5-4135-a5c1-8037e24e601c', 'serial': '2e99e75c-34b5-4135-a5c1-8037e24e601c'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:15:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:15:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGldaLXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:15 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:15 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:15 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d6c14-37ad-4a12-97be-a180d2789ca2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:15:15 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c2987-ab3c-4754-b1b4-e62f7bb45fd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c] added
Apr 11 17:15:15 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf15165-0356-4e70-a437-48cbfc7f1e10]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cdfa55-f7bf-4165-8a08-e84dd4f66752]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGldaLXt {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jGldaLXt" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed274f-9992-4f34-90bd-a00e27fb4072]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jGldaLXt'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8c23f5-7060-432b-82a0-61b4504c07b5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc6b6c-0233-4121-a1c4-09295dca985c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[814152a1-4f75-49dd-bd2a-48a0c7942e77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260]
Apr 11 17:15:16 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260] successful.
Apr 11 17:15:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a5803-4fbf-4fa7-bc97-d263f7d4ebd6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[070d21d6-5ce2-4413-8d7d-d5b3a24addf1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:16 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5dd1b6-e665-4c25-8b12-78d871bb39f0]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGldaLXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23234396535633634', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234396535633634', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599483328',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-0cbmthnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:15:11Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=df974dc8-deda-4bdb-bb9d-1471bee040a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid df974dc8-deda-4bdb-bb9d-1471bee040a7 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:15:17 user nova-compute[71063]:   <uuid>df974dc8-deda-4bdb-bb9d-1471bee040a7</uuid>
Apr 11 17:15:17 user nova-compute[71063]:   <name>instance-0000001e</name>
Apr 11 17:15:17 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:15:17 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:15:17 user nova-compute[71063]:   <metadata>
Apr 11 17:15:17 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:15:17 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:15:17 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1599483328</nova:name>
Apr 11 17:15:17 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:15:15</nova:creationTime>
Apr 11 17:15:17 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:15:17 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:15:17 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:15:17 user nova-compute[71063]:       <nova:owner>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:15:17 user nova-compute[71063]:       </nova:owner>
Apr 11 17:15:17 user nova-compute[71063]:       <nova:ports>
Apr 11 17:15:17 user nova-compute[71063]:         <nova:port uuid="11a50593-74fe-4bfd-adc1-15e1537afc66">
Apr 11 17:15:17 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 17:15:17 user nova-compute[71063]:         </nova:port>
Apr 11 17:15:17 user nova-compute[71063]:       </nova:ports>
Apr 11 17:15:17 user nova-compute[71063]:     </nova:instance>
Apr 11 17:15:17 user nova-compute[71063]:   </metadata>
Apr 11 17:15:17 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:15:17 user nova-compute[71063]:     <system>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="serial">df974dc8-deda-4bdb-bb9d-1471bee040a7</entry>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="uuid">df974dc8-deda-4bdb-bb9d-1471bee040a7</entry>
Apr 11 17:15:17 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:15:17 user nova-compute[71063]:     </system>
Apr 11 17:15:17 user nova-compute[71063]:   </sysinfo>
Apr 11 17:15:17 user nova-compute[71063]:   <os>
Apr 11 17:15:17 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:15:17 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:15:17 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:15:17 user nova-compute[71063]:   </os>
Apr 11 17:15:17 user nova-compute[71063]:   <features>
Apr 11 17:15:17 user nova-compute[71063]:     <acpi/>
Apr 11 17:15:17 user nova-compute[71063]:     <apic/>
Apr 11 17:15:17 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:15:17 user nova-compute[71063]:   </features>
Apr 11 17:15:17 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:15:17 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:15:17 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:15:17 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:15:17 user nova-compute[71063]:   </clock>
Apr 11 17:15:17 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:15:17 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:15:17 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:15:17 user nova-compute[71063]:   </cpu>
Apr 11 17:15:17 user nova-compute[71063]:   <devices>
Apr 11 17:15:17 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:15:17 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:17 user nova-compute[71063]:       <source dev="/dev/sdf"/>
Apr 11 17:15:17 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:15:17 user nova-compute[71063]:       <serial>2e99e75c-34b5-4135-a5c1-8037e24e601c</serial>
Apr 11 17:15:17 user nova-compute[71063]:     </disk>
Apr 11 17:15:17 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:15:17 user nova-compute[71063]:       <mac address="fa:16:3e:94:57:89"/>
Apr 11 17:15:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:15:17 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:15:17 user nova-compute[71063]:       <target dev="tap11a50593-74"/>
Apr 11 17:15:17 user nova-compute[71063]:     </interface>
Apr 11 17:15:17 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:15:17 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/df974dc8-deda-4bdb-bb9d-1471bee040a7/console.log" append="off"/>
Apr 11 17:15:17 user nova-compute[71063]:     </serial>
Apr 11 17:15:17 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:15:17 user nova-compute[71063]:     <video>
Apr 11 17:15:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:15:17 user nova-compute[71063]:     </video>
Apr 11 17:15:17 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:15:17 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:15:17 user nova-compute[71063]:     </rng>
Apr 11 17:15:17 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:15:17 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:15:17 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:15:17 user nova-compute[71063]:     </memballoon>
Apr 11 17:15:17 user nova-compute[71063]:   </devices>
Apr 11 17:15:17 user nova-compute[71063]: </domain>
Apr 11 17:15:17 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599483328',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-0cbmthnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:15:11Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=df974dc8-deda-4bdb-bb9d-1471bee040a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG os_vif [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11a50593-74, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11a50593-74, col_values=(('external_ids', {'iface-id': '11a50593-74fe-4bfd-adc1-15e1537afc66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:57:89', 'vm-uuid': 'df974dc8-deda-4bdb-bb9d-1471bee040a7'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:17 user nova-compute[71063]: INFO os_vif [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74')
Apr 11 17:15:17 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:15:17 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=26.26264190673828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:94:57:89, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance c5bb4495-9a2d-4903-8158-c57b78e43705 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 771531ad-b1f4-486a-b70f-f46837df58b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] No waiting events found dispatching network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:19 user nova-compute[71063]: WARNING nova.compute.manager [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received unexpected event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 for instance with vm_state building and task_state spawning.
Apr 11 17:15:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233321.165271, df974dc8-deda-4bdb-bb9d-1471bee040a7 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] VM Resumed (Lifecycle Event)
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Instance spawned successfully.
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233321.1694694, df974dc8-deda-4bdb-bb9d-1471bee040a7 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] VM Started (Lifecycle Event)
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Took 5.46 seconds to spawn the instance on the hypervisor.
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] No waiting events found dispatching network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:21 user nova-compute[71063]: WARNING nova.compute.manager [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received unexpected event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 for instance with vm_state building and task_state spawning.
Apr 11 17:15:21 user nova-compute[71063]: INFO nova.compute.manager [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Took 10.90 seconds to build instance.
Apr 11 17:15:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.992s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:28 user nova-compute[71063]: INFO nova.compute.manager [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Unrescuing
Apr 11 17:15:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:15:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:15:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:29 user nova-compute[71063]: WARNING nova.compute.manager [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:15:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance destroyed successfully.
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:31 user nova-compute[71063]: WARNING nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:31 user nova-compute[71063]: WARNING nova.compute.manager [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-changed-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Refreshing instance network info cache due to event network-changed-468963af-7fdf-43f9-9be8-b1569345361e. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Acquiring lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Acquired lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:15:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Refreshing network info cache for port 468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:15:32 user nova-compute[71063]: DEBUG nova.network.neutron [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updated VIF entry in instance network info cache for port 468963af-7fdf-43f9-9be8-b1569345361e. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:15:32 user nova-compute[71063]: DEBUG nova.network.neutron [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating instance_info_cache with network_info: [{"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Releasing lock "refresh_cache-771531ad-b1f4-486a-b70f-f46837df58b5" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:15:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233333.3763657, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Resumed (Lifecycle Event)
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:33 user nova-compute[71063]: INFO nova.compute.manager [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attaching volume 40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 to /dev/vdb
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233333.3767633, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:15:33 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Started (Lifecycle Event)
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.utils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d177846-191b-4e43-bec3-4f13c655982e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[06687f30-88c8-4c74-b038-5f541d90d139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d98f4b-5093-4b8a-b503-b2298925261d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad70bba-0088-49bd-85f8-560aefa5676a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:33 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecc8118-2808-49b5-ba3e-de270bc9fc43]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG os_brick.utils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating existing volume attachment record: 23e946ec-5d55-45df-ba04-733c5c428e5e {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:33 user nova-compute[71063]: WARNING nova.compute.manager [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state active and task_state None.
Apr 11 17:15:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFwdYjNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:37 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:15:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a9986-d09e-493d-b74a-18ccd2b0cc9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:15:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[756fabcd-ec91-4321-87cb-6b1e4851fd6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9] added
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[284cd095-17c8-40e6-8f33-5938573d6efe]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8646b644-c107-4f59-9c13-a4c7cdddd0a2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFwdYjNy {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFwdYjNy" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[139c363b-b0dc-4186-ae41-e90563dab0a0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFwdYjNy'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccedbbd-b297-4a50-b5b6-684179bd96b2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c77306-5cb3-4fe0-b220-8524c68aff19]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[494d93ee-6401-4357-87ba-f5cfdcbb2cf8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260]
Apr 11 17:15:38 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260] successful.
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f9ec9-3b05-4422-ac29-5145fc08641a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8a1777-ed86-48f3-a37c-4067ef242554]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:38 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2b56cf-873e-4152-bae1-9d23da5223b1]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFwdYjNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:15:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23261336363663738', 'path': '/dev/sdg'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261336363663738', 'path': '/dev/sdg'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:15:39 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:39 user nova-compute[71063]:   <source dev="/dev/sdg"/>
Apr 11 17:15:39 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:15:39 user nova-compute[71063]:   <serial>40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9</serial>
Apr 11 17:15:39 user nova-compute[71063]: </disk>
Apr 11 17:15:39 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No VIF found with MAC fa:16:3e:3e:94:61, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:15:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.453s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:42 user nova-compute[71063]: INFO nova.compute.manager [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attaching volume 454a12d7-9043-46e0-96ba-e6aaa9a47fef to /dev/vdc
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.utils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e167ab-afbf-4bbf-b3bf-4a3eaa01f48c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf401f87-d758-4723-9dc1-12878fb438e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d906cdae-4b58-431e-8bfa-3675437c71f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e74d1a-716d-4bce-88f9-e6be3d096444]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:15:42 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:15:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c5e053-eb6c-4863-8ae6-9018a55e9b91]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG os_brick.utils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:42 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating existing volume attachment record: e9ef7c53-0ffc-494b-8f76-5152feefcff5 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:15:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnmkaVFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:47 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:47 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:47 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef2d762-53af-4341-ae3d-201899fc532a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:15:47 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[153cdccb-0a0a-443f-b35c-47c04da1eb9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef] added
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dea51e-59d1-4a14-848a-41273a197969]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb364791-67f5-4443-b316-d23604fc9e3e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnmkaVFM {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnmkaVFM" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bd2d3e-c26d-4b16-8aa7-8da0433a54f2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnmkaVFM'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e67326a-6f5d-4f67-9d75-84108e04364d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b133afb-6cda-4854-be6d-32eb0f4f273f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[64498c46-192e-4f03-86cc-6122df872fd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260]
Apr 11 17:15:47 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260] successful.
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92323f6-2225-4475-9bf3-7af6f8b8fb98]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e173f3-ce1e-424d-b32b-0908d1a9ff97]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:47 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c43d460-a987-45da-b5ae-59bcccab956b]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:15:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnmkaVFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23766356636323339', 'path': '/dev/sdh'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766356636323339', 'path': '/dev/sdh'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:15:48 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:48 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:15:48 user nova-compute[71063]:   <target dev="vdc" bus="virtio"/>
Apr 11 17:15:48 user nova-compute[71063]:   <serial>454a12d7-9043-46e0-96ba-e6aaa9a47fef</serial>
Apr 11 17:15:48 user nova-compute[71063]: </disk>
Apr 11 17:15:48 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] No VIF found with MAC fa:16:3e:3e:94:61, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:15:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.252s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:49 user nova-compute[71063]: INFO nova.compute.manager [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Detaching volume 40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9
Apr 11 17:15:49 user nova-compute[71063]: INFO nova.virt.block_device [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attempting to driver detach volume 40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 from mountpoint /dev/vdb
Apr 11 17:15:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Attempting to detach device vdb from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:15:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:15:49 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:49 user nova-compute[71063]:   <source dev="/dev/sdg"/>
Apr 11 17:15:49 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:15:49 user nova-compute[71063]:   <serial>40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9</serial>
Apr 11 17:15:49 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:15:49 user nova-compute[71063]: </disk>
Apr 11 17:15:49 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:15:49 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdb from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the persistent domain config.
Apr 11 17:15:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:15:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:15:49 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:49 user nova-compute[71063]:   <source dev="/dev/sdg"/>
Apr 11 17:15:49 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:15:49 user nova-compute[71063]:   <serial>40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9</serial>
Apr 11 17:15:49 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:15:49 user nova-compute[71063]: </disk>
Apr 11 17:15:49 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233350.1477785, 771531ad-b1f4-486a-b70f-f46837df58b5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:15:50 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdb from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the live domain config.
Apr 11 17:15:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFwdYjNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:50 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12d4c0e-6152-4dea-980a-9cfc308c18da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:15:50 user nova-compute[71063]: No targets found.
Apr 11 17:15:50 user nova-compute[71063]: iSNS:
Apr 11 17:15:50 user nova-compute[71063]: No targets found.
Apr 11 17:15:50 user nova-compute[71063]: STATIC:
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:15:50 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:50 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:50 user nova-compute[71063]: FIRMWARE:
Apr 11 17:15:50 user nova-compute[71063]: No targets found.
Apr 11 17:15:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:15:50 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:15:50 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ef4523-fd3a-46c5-9131-4cb41db87e1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef07cb13-c958-497d-ba94-2d43b86cadf9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 (non-flash)
Apr 11 17:15:50 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80719630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9'): ({'sdg'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Removing single pathed devices sdg {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a30ee5-075b-4191-ba8e-b7199bb89354]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d41e25-5930-42b9-bb54-478a6a68b6a2]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flushing IO for device /dev/sdg {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfd6417-0a53-4c13-b76e-c8854a32bfb0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bc0dd-e334-4eef-a63f-0c528720d638]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2ee1d7-9d68-4cfa-8b85-b8bc891fc374]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2092be0e-5288-4845-9ffb-af2f824359ba]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260]
Apr 11 17:15:50 user nova-compute[71063]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9, portal: 172.16.0.220,3260] successful.
Apr 11 17:15:50 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a2ec24-49a7-46c4-b66c-3f1c6f4d25c7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== disconnect_volume: return (371ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:15:51 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.855s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:52 user nova-compute[71063]: INFO nova.compute.manager [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Detaching volume 454a12d7-9043-46e0-96ba-e6aaa9a47fef
Apr 11 17:15:52 user nova-compute[71063]: INFO nova.virt.block_device [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Attempting to driver detach volume 454a12d7-9043-46e0-96ba-e6aaa9a47fef from mountpoint /dev/vdc
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Attempting to detach device vdc from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:15:52 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:52 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:15:52 user nova-compute[71063]:   <target dev="vdc" bus="virtio"/>
Apr 11 17:15:52 user nova-compute[71063]:   <serial>454a12d7-9043-46e0-96ba-e6aaa9a47fef</serial>
Apr 11 17:15:52 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 17:15:52 user nova-compute[71063]: </disk>
Apr 11 17:15:52 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:15:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdc from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the persistent domain config.
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:15:52 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:15:52 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:15:52 user nova-compute[71063]:   <target dev="vdc" bus="virtio"/>
Apr 11 17:15:52 user nova-compute[71063]:   <serial>454a12d7-9043-46e0-96ba-e6aaa9a47fef</serial>
Apr 11 17:15:52 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 17:15:52 user nova-compute[71063]: </disk>
Apr 11 17:15:52 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233352.6406894, 771531ad-b1f4-486a-b70f-f46837df58b5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:15:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully detached device vdc from instance 771531ad-b1f4-486a-b70f-f46837df58b5 from the live domain config.
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnmkaVFM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:15:52 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c61e78-6dbf-43c6-aecf-a955ba5ac6d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:15:52 user nova-compute[71063]: No targets found.
Apr 11 17:15:52 user nova-compute[71063]: iSNS:
Apr 11 17:15:52 user nova-compute[71063]: No targets found.
Apr 11 17:15:52 user nova-compute[71063]: STATIC:
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:15:52 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:15:52 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:15:52 user nova-compute[71063]: FIRMWARE:
Apr 11 17:15:52 user nova-compute[71063]: No targets found.
Apr 11 17:15:52 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:15:52 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:15:52 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceadf3b9-eb4f-4907-aacd-2a966a7dbb81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db099c6-a958-4c0c-b285-88d6f2b8e165]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:52 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:15:52 user nova-compute[71063]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef (non-flash)
Apr 11 17:15:52 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbebe491750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef'): ({'sdh'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Removing single pathed devices sdh {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e40569-9181-4d28-a857-6f30e276f1b0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5387c775-d577-4fa0-8464-14027bbeecba]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flushing IO for device /dev/sdh {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41561e-31ac-4bf6-bcf1-0a3f3954e091]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.066s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db28b33-2ea9-4917-a932-00f79e7bfc3d]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8580172-e1b9-4772-8488-fa0fefa37fff]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ea14d-23fc-444a-a09b-21e4b71f9082]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260]
Apr 11 17:15:52 user nova-compute[71063]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef, portal: 172.16.0.220,3260] successful.
Apr 11 17:15:52 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:454a12d7-9043-46e0-96ba-e6aaa9a47fef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d8ec2-25a7-4e04-99a8-2f86492cd8a7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] <== disconnect_volume: return (345ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:15:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:15:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:53 user nova-compute[71063]: DEBUG nova.objects.instance [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'flavor' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.696s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:54 user nova-compute[71063]: INFO nova.compute.manager [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Terminating instance
Apr 11 17:15:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-unplugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] No waiting events found dispatching network-vif-unplugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-unplugged-468963af-7fdf-43f9-9be8-b1569345361e for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:15:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Instance destroyed successfully.
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'resources' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673575885',display_name='tempest-AttachVolumeTestJSON-server-1673575885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673575885',id=27,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLGA7ITRVNn7GjLSzkVsG9qllpiTLCnVwtVaAGuq9WnIK8VQYMWagqSqLSEUWmmtBFT/JnilDnpp1MRrDJ/InQ4R18JevW4oC7hjIRIQnHR5O9JyvqVM7iBsqyLgBUo4A==',key_name='tempest-keypair-1520901621',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:13:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c902eb30be24cc6bd26c0ab7036d037',ramdisk_id='',reservation_id='r-x7wv0myk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1071232138',owner_user_name='tempest-AttachVolumeTestJSON-1071232138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac0109eab2dc45fe824a03e2d09fa022',uuid=771531ad-b1f4-486a-b70f-f46837df58b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converting VIF {"id": "468963af-7fdf-43f9-9be8-b1569345361e", "address": "fa:16:3e:3e:94:61", "network": {"id": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1196530015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c902eb30be24cc6bd26c0ab7036d037", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap468963af-7f", "ovs_interfaceid": "468963af-7fdf-43f9-9be8-b1569345361e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG os_vif [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap468963af-7f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:15:55 user nova-compute[71063]: INFO os_vif [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:94:61,bridge_name='br-int',has_traffic_filtering=True,id=468963af-7fdf-43f9-9be8-b1569345361e,network=Network(6fe2f45e-c84e-4b74-af4a-118b0bfc9824),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap468963af-7f')
Apr 11 17:15:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Deleting instance files /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5_del
Apr 11 17:15:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Deletion of /opt/stack/data/nova/instances/771531ad-b1f4-486a-b70f-f46837df58b5_del complete
Apr 11 17:15:55 user nova-compute[71063]: INFO nova.compute.manager [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:15:55 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:15:55 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:15:56 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Took 0.89 seconds to deallocate network for instance.
Apr 11 17:15:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-deleted-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:15:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:56 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Deleted allocations for instance 771531ad-b1f4-486a-b70f-f46837df58b5
Apr 11 17:15:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "771531ad-b1f4-486a-b70f-f46837df58b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:15:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Acquiring lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:15:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:15:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Lock "771531ad-b1f4-486a-b70f-f46837df58b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:15:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] No waiting events found dispatching network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:15:57 user nova-compute[71063]: WARNING nova.compute.manager [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Received unexpected event network-vif-plugged-468963af-7fdf-43f9-9be8-b1569345361e for instance with vm_state deleted and task_state None.
Apr 11 17:16:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:16:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [{"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-1fc7677c-cbd9-48e7-be62-2210074bc87a" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:16:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:16:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233355.4393559, 771531ad-b1f4-486a-b70f-f46837df58b5 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:10 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] VM Stopped (Lifecycle Event)
Apr 11 17:16:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-557edb49-4643-4a35-a8a1-bef707f15ad2 None None] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:16:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:12 user nova-compute[71063]: INFO nova.compute.manager [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Terminating instance
Apr 11 17:16:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Instance destroyed successfully.
Apr 11 17:16:12 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lazy-loading 'resources' on Instance uuid c5bb4495-9a2d-4903-8158-c57b78e43705 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-567354548',display_name='tempest-ServersNegativeTestJSON-server-567354548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-567354548',id=18,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1c61fd594564317a51c9dadebbba6c7',ramdisk_id='',reservation_id='r-qaqfxllv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1657059206',owner_user_name='tempest-ServersNegativeTestJSON-1657059206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:07:43Z,user_data=None,user_id='d0c53186c18940aba415e0b999cbc2a0',uuid=c5bb4495-9a2d-4903-8158-c57b78e43705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converting VIF {"id": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "address": "fa:16:3e:72:50:8f", "network": {"id": "fc5f2351-9e4e-4481-9745-87fe310d86e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1664441373-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1c61fd594564317a51c9dadebbba6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15355548-ee", "ovs_interfaceid": "15355548-ee2d-4cc0-abd1-44a292fa87dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG os_vif [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15355548-ee, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:12 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:16:12 user nova-compute[71063]: INFO os_vif [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:50:8f,bridge_name='br-int',has_traffic_filtering=True,id=15355548-ee2d-4cc0-abd1-44a292fa87dc,network=Network(fc5f2351-9e4e-4481-9745-87fe310d86e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15355548-ee')
Apr 11 17:16:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Deleting instance files /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705_del
Apr 11 17:16:12 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Deletion of /opt/stack/data/nova/instances/c5bb4495-9a2d-4903-8158-c57b78e43705_del complete
Apr 11 17:16:13 user nova-compute[71063]: INFO nova.compute.manager [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-unplugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] No waiting events found dispatching network-vif-unplugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-unplugged-15355548-ee2d-4cc0-abd1-44a292fa87dc for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:13 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Took 0.91 seconds to deallocate network for instance.
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:14 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:16:14 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:16:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:14 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Deleted allocations for instance c5bb4495-9a2d-4903-8158-c57b78e43705
Apr 11 17:16:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Acquiring lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Lock "c5bb4495-9a2d-4903-8158-c57b78e43705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] No waiting events found dispatching network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:15 user nova-compute[71063]: WARNING nova.compute.manager [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received unexpected event network-vif-plugged-15355548-ee2d-4cc0-abd1-44a292fa87dc for instance with vm_state deleted and task_state None.
Apr 11 17:16:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Received event network-vif-deleted-15355548-ee2d-4cc0-abd1-44a292fa87dc {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:19 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:16:19 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=26.309490203857422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:16:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:27 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233372.8790588, c5bb4495-9a2d-4903-8158-c57b78e43705 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:27 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] VM Stopped (Lifecycle Event)
Apr 11 17:16:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8782b55e-cd34-4de3-890a-2e0fb4a31ae4 None None] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing instance network info cache due to event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updated VIF entry in instance network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:16:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:30 user nova-compute[71063]: INFO nova.compute.manager [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Shelving
Apr 11 17:16:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:31 user nova-compute[71063]: WARNING nova.compute.manager [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state active and task_state shelving.
Apr 11 17:16:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance destroyed successfully.
Apr 11 17:16:31 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Beginning cold snapshot process
Apr 11 17:16:31 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:16:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk /opt/stack/data/nova/instances/snapshots/tmpycx_ofmh/7ab47096fdd84a68916d93d9627f3fc8 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk /opt/stack/data/nova/instances/snapshots/tmpycx_ofmh/7ab47096fdd84a68916d93d9627f3fc8" returned: 0 in 0.373s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Snapshot extracted, beginning image upload
Apr 11 17:16:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:33 user nova-compute[71063]: WARNING nova.compute.manager [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 17:16:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Snapshot image upload complete
Apr 11 17:16:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:34 user nova-compute[71063]: INFO nova.compute.manager [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Shelve offloading
Apr 11 17:16:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance destroyed successfully.
Apr 11 17:16:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:16:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:16:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:16:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:16:35 user nova-compute[71063]: INFO nova.compute.manager [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Rescuing
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:16:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance destroyed successfully.
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'resources' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFqFHOn8aPRX0q5MSRPMTTacpD4HYx1m4dQ1XGm7PdPNjP6f9xXOv0GIXZGtAqKHrXu3xeE1uYxfyAMROxwbD8IK2W1cFmzOptY72oYUTM7AtAciDDzgNoF5MkpmQhYKg==',key_name='tempest-keypair-385713192',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:16:34.378433',shelved_host='user',shelved_image_id='6beaf0d5-984f-4806-8985-dcd7e82ccaf4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG os_vif [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d7d89bc-13, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:35 user nova-compute[71063]: INFO os_vif [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13')
Apr 11 17:16:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Deleting instance files /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2_del
Apr 11 17:16:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Deletion of /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2_del complete
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing instance network info cache due to event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:16:35 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Deleted allocations for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'numa_topology' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updated VIF entry in instance network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.253s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:36 user nova-compute[71063]: WARNING nova.compute.manager [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state rescuing.
Apr 11 17:16:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance destroyed successfully.
Apr 11 17:16:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Attempting a stable device rescue
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71063) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:16:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Creating image(s)
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG nova.virt.images [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 893b2f97-eeff-46ce-bac8-20a35139827e was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.part /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.part /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.converted" returned: 0 in 0.402s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.253s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2,backing_fmt=raw /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f8ed59e091067488f6686fbf824df2bd6507e3b2,backing_fmt=raw /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue" returned: 0 in 0.051s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "f8ed59e091067488f6686fbf824df2bd6507e3b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'migration_context' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start _get_guest_xml network_info=[{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:96:7c:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '893b2f97-eeff-46ce-bac8-20a35139827e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'f3c38b21-097e-4ec5-b47d-adf9768f07a5', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'serial': 'e685fee6-6f2e-47b1-9241-988ab7c7ec08'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'numa_topology' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:38 user nova-compute[71063]: WARNING nova.compute.manager [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state rescuing.
Apr 11 17:16:38 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:16:38 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:16:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:16:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:16:38 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed761be-f433-471b-b539-e344ff3336d7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PcFTufSB\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 17:16:38 user nova-compute[71063]: node.name = iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:16:38 user nova-compute[71063]: node.tpgt = -1
Apr 11 17:16:38 user nova-compute[71063]: node.startup = automatic
Apr 11 17:16:38 user nova-compute[71063]: node.leading_login = No
Apr 11 17:16:38 user nova-compute[71063]: iface.iscsi_ifacename = default
Apr 11 17:16:38 user nova-compute[71063]: iface.net_ifacename = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.ipaddress = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.prefix_len = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.hwaddress = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.transport_name = tcp
Apr 11 17:16:38 user nova-compute[71063]: iface.initiatorname = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.vlan_id = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.vlan_priority = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.vlan_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.iface_num = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.mtu = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.port = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.bootproto = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.subnet_mask = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.gateway = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_alt_client_id = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_dns = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_learn_iqn = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_vendor_id_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_vendor_id = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.dhcp_slp_da = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.fragmentation = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.gratuitous_arp = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.incoming_forwarding = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.tos_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.tos = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.ttl = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.delayed_ack = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.tcp_nagle = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.tcp_wsf_state = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.tcp_wsf = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.tcp_timer_scale = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.tcp_timestamp = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.redirect = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.def_task_mgmt_timeout = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.header_digest = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.data_digest = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.immediate_data = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.initial_r2t = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.data_seq_inorder = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.data_pdu_inorder = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.erl = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.max_receive_data_len = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.first_burst_len = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.max_outstanding_r2t = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.max_burst_len = 0
Apr 11 17:16:38 user nova-compute[71063]: iface.chap_auth = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.bidi_chap = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.strict_login_compliance = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.discovery_auth = <empty>
Apr 11 17:16:38 user nova-compute[71063]: iface.discovery_logout = <empty>
Apr 11 17:16:38 user nova-compute[71063]: node.discovery_address = <empty>
Apr 11 17:16:38 user nova-compute[71063]: node.discovery_port = 0
Apr 11 17:16:38 user nova-compute[71063]: node.discovery_type = static
Apr 11 17:16:38 user nova-compute[71063]: node.session.initial_cmdsn = 0
Apr 11 17:16:38 user nova-compute[71063]: node.session.initial_login_retry_max = 8
Apr 11 17:16:38 user nova-compute[71063]: node.session.xmit_thread_priority = -20
Apr 11 17:16:38 user nova-compute[71063]: node.session.cmds_max = 128
Apr 11 17:16:38 user nova-compute[71063]: node.session.queue_depth = 32
Apr 11 17:16:38 user nova-compute[71063]: node.session.nr_sessions = 1
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.authmethod = CHAP
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.username = PcFTufSB
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.password = ***
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.username_in = <empty>
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.password_in = <empty>
Apr 11 17:16:38 user nova-compute[71063]: node.session.auth.chap_algs = MD5
Apr 11 17:16:38 user nova-compute[71063]: node.session.timeo.replacement_timeout = 120
Apr 11 17:16:38 user nova-compute[71063]: node.session.err_timeo.abort_timeout = 15
Apr 11 17:16:38 user nova-compute[71063]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 17:16:38 user nova-compute[71063]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 17:16:38 user nova-compute[71063]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.FastAbort = Yes
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.InitialR2T = No
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.ImmediateData = Yes
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.MaxConnections = 1
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 17:16:38 user nova-compute[71063]: node.session.iscsi.ERL = 0
Apr 11 17:16:38 user nova-compute[71063]: node.session.scan = manual
Apr 11 17:16:38 user nova-compute[71063]: node.session.reopen_max = 0
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].address = 172.16.0.220
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].port = 3260
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].startup = manual
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].tcp.window_size = 524288
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].tcp.type_of_service = 0
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].timeo.logout_timeout = 15
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].timeo.login_timeout = 15
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].timeo.auth_timeout = 45
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.DataDigest = None
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.IFMarker = No
Apr 11 17:16:38 user nova-compute[71063]: node.conn[0].iscsi.OFMarker = No
Apr 11 17:16:38 user nova-compute[71063]: # END RECORD
Apr 11 17:16:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d72f767-7b67-4fbd-80c7-e90d3665abc7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce92b2-405e-4e6b-a96a-f7bc6b4dd12c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcFTufSB {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PcFTufSB" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[933ac1eb-bff8-454b-bff3-00c8adebc792]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PcFTufSB'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb064f6d-3450-4ad0-8dae-24d9e03ea9c8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8009b3c8-237c-41c2-8a42-ce6744094c1d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:16:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:16:38 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:16:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HCTL ('36', '0', '0', 0) found on session 33 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[513905f4-a587-4649-8c4b-7ae7ae805f74]: (4, ('0 0 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Searching for a device in session 33 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23834303132643930', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834303132643930', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632176154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632176154',id=29,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-nxqs7k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:15:01Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:96:7c:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "vif_mac": "fa:16:3e:96:7c:6c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'pci_devices' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:16:38 user nova-compute[71063]:   <uuid>85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</uuid>
Apr 11 17:16:38 user nova-compute[71063]:   <name>instance-0000001d</name>
Apr 11 17:16:38 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:16:38 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:16:38 user nova-compute[71063]:   <metadata>
Apr 11 17:16:38 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:16:38 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1632176154</nova:name>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:16:38</nova:creationTime>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:16:38 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:16:38 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:owner>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:user uuid="79b5fefb1e9748b8bf51535099bf5327">tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member</nova:user>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:project uuid="361d59e2f9ac4a68a1a738cc3f2a9d14">tempest-ServerBootFromVolumeStableRescueTest-1329171675</nova:project>
Apr 11 17:16:38 user nova-compute[71063]:       </nova:owner>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:16:38 user nova-compute[71063]:       <nova:ports>
Apr 11 17:16:38 user nova-compute[71063]:         <nova:port uuid="7436f349-9b31-46f1-9866-ad1d71d06e06">
Apr 11 17:16:38 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:16:38 user nova-compute[71063]:         </nova:port>
Apr 11 17:16:38 user nova-compute[71063]:       </nova:ports>
Apr 11 17:16:38 user nova-compute[71063]:     </nova:instance>
Apr 11 17:16:38 user nova-compute[71063]:   </metadata>
Apr 11 17:16:38 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:16:38 user nova-compute[71063]:     <system>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="serial">85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</entry>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="uuid">85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8</entry>
Apr 11 17:16:38 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:16:38 user nova-compute[71063]:     </system>
Apr 11 17:16:38 user nova-compute[71063]:   </sysinfo>
Apr 11 17:16:38 user nova-compute[71063]:   <os>
Apr 11 17:16:38 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:16:38 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:16:38 user nova-compute[71063]:   </os>
Apr 11 17:16:38 user nova-compute[71063]:   <features>
Apr 11 17:16:38 user nova-compute[71063]:     <acpi/>
Apr 11 17:16:38 user nova-compute[71063]:     <apic/>
Apr 11 17:16:38 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:16:38 user nova-compute[71063]:   </features>
Apr 11 17:16:38 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:16:38 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:16:38 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:16:38 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:16:38 user nova-compute[71063]:   </clock>
Apr 11 17:16:38 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:16:38 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:16:38 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:16:38 user nova-compute[71063]:   </cpu>
Apr 11 17:16:38 user nova-compute[71063]:   <devices>
Apr 11 17:16:38 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:16:38 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:16:38 user nova-compute[71063]:       <source dev="/dev/sde"/>
Apr 11 17:16:38 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:16:38 user nova-compute[71063]:       <serial>e685fee6-6f2e-47b1-9241-988ab7c7ec08</serial>
Apr 11 17:16:38 user nova-compute[71063]:     </disk>
Apr 11 17:16:38 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:16:38 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:16:38 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue"/>
Apr 11 17:16:38 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:16:38 user nova-compute[71063]:       <boot order="1"/>
Apr 11 17:16:38 user nova-compute[71063]:     </disk>
Apr 11 17:16:38 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:16:38 user nova-compute[71063]:       <mac address="fa:16:3e:96:7c:6c"/>
Apr 11 17:16:38 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:16:38 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:16:38 user nova-compute[71063]:       <target dev="tap7436f349-9b"/>
Apr 11 17:16:38 user nova-compute[71063]:     </interface>
Apr 11 17:16:38 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:16:38 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/console.log" append="off"/>
Apr 11 17:16:38 user nova-compute[71063]:     </serial>
Apr 11 17:16:38 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:16:38 user nova-compute[71063]:     <video>
Apr 11 17:16:38 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:16:38 user nova-compute[71063]:     </video>
Apr 11 17:16:38 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:16:38 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:16:38 user nova-compute[71063]:     </rng>
Apr 11 17:16:38 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:16:38 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:16:38 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:16:38 user nova-compute[71063]:     </memballoon>
Apr 11 17:16:38 user nova-compute[71063]:   </devices>
Apr 11 17:16:38 user nova-compute[71063]: </domain>
Apr 11 17:16:38 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:16:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance destroyed successfully.
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] No VIF found with MAC fa:16:3e:96:7c:6c, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:16:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:39 user nova-compute[71063]: INFO nova.compute.manager [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Terminating instance
Apr 11 17:16:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-unplugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:40 user nova-compute[71063]: WARNING nova.compute.manager [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state rescuing.
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Instance destroyed successfully.
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1483979995',display_name='tempest-ServerActionsTestJSON-server-745930106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1483979995',id=4,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:14:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-gxobb1nq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=1fc7677c-cbd9-48e7-be62-2210074bc87a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "6b20a003-d501-4958-9c8c-567343698e97", "address": "fa:16:3e:6d:79:2f", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b20a003-d5", "ovs_interfaceid": "6b20a003-d501-4958-9c8c-567343698e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_vif [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b20a003-d5, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:40 user nova-compute[71063]: INFO os_vif [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:79:2f,bridge_name='br-int',has_traffic_filtering=True,id=6b20a003-d501-4958-9c8c-567343698e97,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b20a003-d5')
Apr 11 17:16:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xpPIoVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:16:40 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[95849bf2-2616-418d-a0c5-3519a31ae9f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:16:40 user nova-compute[71063]: No targets found.
Apr 11 17:16:40 user nova-compute[71063]: iSNS:
Apr 11 17:16:40 user nova-compute[71063]: No targets found.
Apr 11 17:16:40 user nova-compute[71063]: STATIC:
Apr 11 17:16:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:16:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:16:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:16:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:16:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:16:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:16:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:16:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:16:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:16:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4
Apr 11 17:16:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:16:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:16:40 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:16:40 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:16:40 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:16:40 user nova-compute[71063]: FIRMWARE:
Apr 11 17:16:40 user nova-compute[71063]: No targets found.
Apr 11 17:16:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:16:40 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:16:40 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd7da8-6488-4e56-b7b9-a6349e7524ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab0dc4-0771-4301-942e-f8a44fce0a0c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:16:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:16:40 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:16:40 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec1632dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6122ea31-0c55-42ee-bd8a-afe93e08606c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea5d953-5515-47fb-bd27-4c05e9c3e27b]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee7f682-6b7c-47c4-9402-ad33dc883115]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae1c39-052f-433f-a3aa-437cd8f9287f]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812e53d-c9db-4cf1-b2b6-9d485dc244d1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:40 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa88b87-87f9-435e-bc89-46a8b454d4ec]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260]
Apr 11 17:16:41 user nova-compute[71063]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4, portal: 172.16.0.220,3260] successful.
Apr 11 17:16:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[26284ae9-7329-4804-ade1-cfa26b6ec58c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (314ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:16:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Deleting instance files /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_del
Apr 11 17:16:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Deletion of /opt/stack/data/nova/instances/1fc7677c-cbd9-48e7-be62-2210074bc87a_del complete
Apr 11 17:16:41 user nova-compute[71063]: INFO nova.compute.manager [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Took 1.46 seconds to destroy the instance on the hypervisor.
Apr 11 17:16:41 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:16:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:16:41 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Took 0.79 seconds to deallocate network for instance.
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Acquiring lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] No waiting events found dispatching network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:42 user nova-compute[71063]: WARNING nova.compute.manager [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received unexpected event network-vif-plugged-6b20a003-d501-4958-9c8c-567343698e97 for instance with vm_state active and task_state deleting.
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Received event network-vif-deleted-6b20a003-d501-4958-9c8c-567343698e97 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233402.4555225, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:42 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Resumed (Lifecycle Event)
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:16:42 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233402.459858, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:42 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Started (Lifecycle Event)
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:16:42 user nova-compute[71063]: WARNING nova.compute.manager [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state rescuing.
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:16:42 user nova-compute[71063]: INFO nova.compute.manager [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Took 0.96 seconds to detach 1 volumes for instance.
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:16:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:16:43 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:16:43 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:16:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:43 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Deleted allocations for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a
Apr 11 17:16:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "1fc7677c-cbd9-48e7-be62-2210074bc87a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.798s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:16:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:46 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233391.6500819, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:46 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Stopped (Lifecycle Event)
Apr 11 17:16:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d1810df3-e533-4ee2-b592-967116436763 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:55 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233400.680537, 1fc7677c-cbd9-48e7-be62-2210074bc87a => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:16:55 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] VM Stopped (Lifecycle Event)
Apr 11 17:16:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-22c64d77-a642-4dd1-b2df-2c7a056c8a71 None None] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:16:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:16:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:17:04 user nova-compute[71063]: INFO nova.compute.claims [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Claim successful on node user
Apr 11 17:17:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:17:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:17:05 user nova-compute[71063]: INFO nova.virt.block_device [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Booting with volume snapshot c7391171-35b0-4045-ba02-df762e8b6833 at /dev/vda
Apr 11 17:17:05 user nova-compute[71063]: DEBUG nova.policy [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:17:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Skipping network cache update for instance because it is Building. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Successfully created port: ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:17:06 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [{"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-25935a69-292b-4d55-932c-f4893838998c" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Successfully updated port: ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-changed-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Refreshing instance network info cache due to event network-changed-ace52784-2fcb-440a-8ff5-4fa05c330f9b. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Acquiring lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updating instance_info_cache with network_info: [{"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Instance network_info: |[{"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Acquired lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:07 user nova-compute[71063]: DEBUG nova.network.neutron [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Refreshing network info cache for port ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:08 user nova-compute[71063]: DEBUG nova.network.neutron [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updated VIF entry in instance network info cache for port ace52784-2fcb-440a-8ff5-4fa05c330f9b. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:08 user nova-compute[71063]: DEBUG nova.network.neutron [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updating instance_info_cache with network_info: [{"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Releasing lock "refresh_cache-d0b8cd04-945b-4926-b7fb-b6c65ed0164d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:17:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.utils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[838f5f1a-cb30-4298-ade7-94c2bce2c79f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[46754013-4d78-40e0-94c3-2035dde1f6d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6348b753-269d-4fc7-835f-e0f4e53cd23e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1decc0f-4a67-43dd-a130-a699764148b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:17:11 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:17:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ea539-f5b8-484a-a576-1a65ebb0a47d]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG os_brick.utils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updating existing volume attachment record: 3e405ba8-7177-434a-8368-bf5897646308 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:17:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:17:15 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Creating image(s)
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Ensure instance console log exists: /opt/stack/data/nova/instances/d0b8cd04-945b-4926-b7fb-b6c65ed0164d/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Start _get_guest_xml network_info=[{"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T17:17:02Z,direct_url=<?>,disk_format='qcow2',id=273f8606-84b3-45d3-b376-88cb98e870e6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1281409480',owner='631ee1e131e94577b853a5ae0886a318',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T17:17:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '3e405ba8-7177-434a-8368-bf5897646308', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoeSXli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0b8cd04-945b-4926-b7fb-b6c65ed0164d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 'serial': 'f8efb73f-45cb-4cab-b65a-dd2e3900e4c5'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:17:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:15 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T17:17:02Z,direct_url=<?>,disk_format='qcow2',id=273f8606-84b3-45d3-b376-88cb98e870e6,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1281409480',owner='631ee1e131e94577b853a5ae0886a318',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T17:17:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoeSXli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:17:15 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:17:15 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:17:15 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[72edc3fd-e0e7-4302-a4ad-fbb805b2f141]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:17:15 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12507c9-6032-40d7-a546-3ee2c74ee314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5] added
Apr 11 17:17:15 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffba510-556b-4a66-b73d-d1e0337feaa5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e438a-3a27-4ba2-9afb-c25de2f1ba01]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgoeSXli {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VgoeSXli" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ca0ac-9464-40d8-a401-102dc383a399]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VgoeSXli'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0817dc59-ae27-413e-b702-97fe0650a7c3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad8443-2e0a-4257-ac86-9c26707b25e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:15 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:15 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:15 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:17:15 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abcaa9-a9af-42ce-ba61-6c193481544e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260]
Apr 11 17:17:16 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260] successful.
Apr 11 17:17:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb36e7-0767-415d-80ca-f87869c95bf8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41eac08-e5d2-430c-b454-b0cea64d4a51]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:16 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:17:16 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd812ce6-9d51-45e2-b7b1-43cdfb255979]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:16 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoeSXli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23665323263343161', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665323263343161', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-526047112',id=31,image_ref='273f8606-84b3-45d3-b376-88cb98e870e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-pzo3yegv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-665298870',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:05Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=d0b8cd04-945b-4926-b7fb-b6c65ed0164d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid d0b8cd04-945b-4926-b7fb-b6c65ed0164d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:17:17 user nova-compute[71063]:   <uuid>d0b8cd04-945b-4926-b7fb-b6c65ed0164d</uuid>
Apr 11 17:17:17 user nova-compute[71063]:   <name>instance-0000001f</name>
Apr 11 17:17:17 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:17:17 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:17:17 user nova-compute[71063]:   <metadata>
Apr 11 17:17:17 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:17:17 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-526047112</nova:name>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:17:15</nova:creationTime>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:17:17 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:17:17 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:owner>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:17:17 user nova-compute[71063]:       </nova:owner>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:root type="image" uuid="273f8606-84b3-45d3-b376-88cb98e870e6"/>
Apr 11 17:17:17 user nova-compute[71063]:       <nova:ports>
Apr 11 17:17:17 user nova-compute[71063]:         <nova:port uuid="ace52784-2fcb-440a-8ff5-4fa05c330f9b">
Apr 11 17:17:17 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 17:17:17 user nova-compute[71063]:         </nova:port>
Apr 11 17:17:17 user nova-compute[71063]:       </nova:ports>
Apr 11 17:17:17 user nova-compute[71063]:     </nova:instance>
Apr 11 17:17:17 user nova-compute[71063]:   </metadata>
Apr 11 17:17:17 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:17:17 user nova-compute[71063]:     <system>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="serial">d0b8cd04-945b-4926-b7fb-b6c65ed0164d</entry>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="uuid">d0b8cd04-945b-4926-b7fb-b6c65ed0164d</entry>
Apr 11 17:17:17 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:17:17 user nova-compute[71063]:     </system>
Apr 11 17:17:17 user nova-compute[71063]:   </sysinfo>
Apr 11 17:17:17 user nova-compute[71063]:   <os>
Apr 11 17:17:17 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:17:17 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:17:17 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:17:17 user nova-compute[71063]:   </os>
Apr 11 17:17:17 user nova-compute[71063]:   <features>
Apr 11 17:17:17 user nova-compute[71063]:     <acpi/>
Apr 11 17:17:17 user nova-compute[71063]:     <apic/>
Apr 11 17:17:17 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:17:17 user nova-compute[71063]:   </features>
Apr 11 17:17:17 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:17:17 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:17:17 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:17:17 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:17:17 user nova-compute[71063]:   </clock>
Apr 11 17:17:17 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:17:17 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:17:17 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:17:17 user nova-compute[71063]:   </cpu>
Apr 11 17:17:17 user nova-compute[71063]:   <devices>
Apr 11 17:17:17 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:17:17 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:17:17 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:17:17 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:17:17 user nova-compute[71063]:       <serial>f8efb73f-45cb-4cab-b65a-dd2e3900e4c5</serial>
Apr 11 17:17:17 user nova-compute[71063]:     </disk>
Apr 11 17:17:17 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:17:17 user nova-compute[71063]:       <mac address="fa:16:3e:10:db:bf"/>
Apr 11 17:17:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:17 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:17:17 user nova-compute[71063]:       <target dev="tapace52784-2f"/>
Apr 11 17:17:17 user nova-compute[71063]:     </interface>
Apr 11 17:17:17 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:17:17 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/d0b8cd04-945b-4926-b7fb-b6c65ed0164d/console.log" append="off"/>
Apr 11 17:17:17 user nova-compute[71063]:     </serial>
Apr 11 17:17:17 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:17:17 user nova-compute[71063]:     <video>
Apr 11 17:17:17 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:17 user nova-compute[71063]:     </video>
Apr 11 17:17:17 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:17:17 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:17:17 user nova-compute[71063]:     </rng>
Apr 11 17:17:17 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:17:17 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:17:17 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:17:17 user nova-compute[71063]:     </memballoon>
Apr 11 17:17:17 user nova-compute[71063]:   </devices>
Apr 11 17:17:17 user nova-compute[71063]: </domain>
Apr 11 17:17:17 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-526047112',id=31,image_ref='273f8606-84b3-45d3-b376-88cb98e870e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-pzo3yegv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-665298870',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:05Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=d0b8cd04-945b-4926-b7fb-b6c65ed0164d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG os_vif [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapace52784-2f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapace52784-2f, col_values=(('external_ids', {'iface-id': 'ace52784-2fcb-440a-8ff5-4fa05c330f9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:db:bf', 'vm-uuid': 'd0b8cd04-945b-4926-b7fb-b6c65ed0164d'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:17 user nova-compute[71063]: INFO os_vif [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f')
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:10:db:bf, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:17:17 user nova-compute[71063]: INFO nova.compute.claims [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Claim successful on node user
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:17:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:17:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:17:18 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Creating image(s)
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.policy [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk 1073741824" returned: 0 in 0.050s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.160s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Cannot resize image /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'migration_context' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Ensure instance console log exists: /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] No waiting events found dispatching network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:18 user nova-compute[71063]: WARNING nova.compute.manager [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received unexpected event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance with vm_state building and task_state spawning.
Apr 11 17:17:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Successfully created port: 4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233440.8222976, d0b8cd04-945b-4926-b7fb-b6c65ed0164d => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] VM Resumed (Lifecycle Event)
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] No waiting events found dispatching network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:20 user nova-compute[71063]: WARNING nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received unexpected event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance with vm_state building and task_state spawning.
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing instance network info cache due to event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.compute.manager [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Detaching volume c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Instance spawned successfully.
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233440.822812, d0b8cd04-945b-4926-b7fb-b6c65ed0164d => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] VM Started (Lifecycle Event)
Apr 11 17:17:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:17:20 user nova-compute[71063]: INFO nova.virt.block_device [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Attempting to driver detach volume c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 from mountpoint /dev/vdb
Apr 11 17:17:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Attempting to detach device vdb from instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:17:21 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:17:21 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:17:21 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:17:21 user nova-compute[71063]:   <serial>c1f959e0-9f24-4e52-b2d6-b756bc69d2e6</serial>
Apr 11 17:17:21 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:17:21 user nova-compute[71063]: </disk>
Apr 11 17:17:21 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:17:21 user nova-compute[71063]: INFO nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:21 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully detached device vdb from instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc from the persistent domain config.
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:17:21 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:17:21 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:17:21 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:17:21 user nova-compute[71063]:   <serial>c1f959e0-9f24-4e52-b2d6-b756bc69d2e6</serial>
Apr 11 17:17:21 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:17:21 user nova-compute[71063]: </disk>
Apr 11 17:17:21 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:21 user nova-compute[71063]: INFO nova.compute.manager [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Took 16.29 seconds to build instance.
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.418s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Successfully updated port: 4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquired lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-changed-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Refreshing instance network info cache due to event network-changed-4ec17eb0-1b20-4679-9900-3fa2850b50b8. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Acquiring lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233441.7191665, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:17:22 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully detached device vdb from instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc from the live domain config.
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sLZqrAtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:17:22 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7976MB free_disk=26.230484008789062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09624a48-a6b9-4bc6-bb6a-fe170e216a56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:17:22 user nova-compute[71063]: No targets found.
Apr 11 17:17:22 user nova-compute[71063]: iSNS:
Apr 11 17:17:22 user nova-compute[71063]: No targets found.
Apr 11 17:17:22 user nova-compute[71063]: STATIC:
Apr 11 17:17:22 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:17:22 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:17:22 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:17:22 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5
Apr 11 17:17:22 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:17:22 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:17:22 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:17:22 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:17:22 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:17:22 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6
Apr 11 17:17:22 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:17:22 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:17:22 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:17:22 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:17:22 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:17:22 user nova-compute[71063]: FIRMWARE:
Apr 11 17:17:22 user nova-compute[71063]: No targets found.
Apr 11 17:17:22 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:17:22 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:17:22 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0648d5-5096-4a68-8ed1-f49bea488209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90340393-495e-4fc9-88bb-fcefc34bd11f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:17:22 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:17:22 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe804ae050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c51be-ed8c-49d7-a106-8cd97d64ad59]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a494ecfe-56e9-4afc-896a-7400ddbaa8b4]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df9262-201b-41cc-b404-3f2cef401aec]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updated VIF entry in instance network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing instance network info cache due to event network-changed-b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquiring lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquired lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Refreshing network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3bee0-51a1-451d-8937-2163287319a0]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddded8f-b07e-4475-97a0-552347b0f1cd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updating instance_info_cache with network_info: [{"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Releasing lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Instance network_info: |[{"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[562fe195-fffd-4806-9a22-64d39f3bc68f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Acquired lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Refreshing network info cache for port 4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Start _get_guest_xml network_info=[{"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260]
Apr 11 17:17:22 user nova-compute[71063]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6, portal: 172.16.0.220,3260] successful.
Apr 11 17:17:22 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466344126',display_name='tempest-AttachVolumeNegativeTest-server-466344126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466344126',id=32,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIiVZRIcFyrvGPDYWVH2yITtiQzaRj2SywIZW4J28+dHZ1qwOIi5RhBpem8WI1Pb6Gr2152T3472CaYxEgZeL4HFHRz9zhJhhcmnLlUaTw8qfm4gEhwuOe1dDzwWwz76g==',key_name='tempest-keypair-1874843256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-jbbbs19g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=b5f9fe94-98f0-4094-8003-53c06cbfd5cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'pci_devices' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4014ee13-7cd9-48e8-af2f-644acc46d3f4]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] <== disconnect_volume: return (479ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:17:22 user nova-compute[71063]:   <uuid>b5f9fe94-98f0-4094-8003-53c06cbfd5cb</uuid>
Apr 11 17:17:22 user nova-compute[71063]:   <name>instance-00000020</name>
Apr 11 17:17:22 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:17:22 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:17:22 user nova-compute[71063]:   <metadata>
Apr 11 17:17:22 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:17:22 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeNegativeTest-server-466344126</nova:name>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:17:22</nova:creationTime>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:17:22 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:17:22 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:owner>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:user uuid="ff27d08254f74491aba3386c9b901300">tempest-AttachVolumeNegativeTest-1862265490-project-member</nova:user>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:project uuid="23c663a759724bbda32f189ceedf6675">tempest-AttachVolumeNegativeTest-1862265490</nova:project>
Apr 11 17:17:22 user nova-compute[71063]:       </nova:owner>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:17:22 user nova-compute[71063]:       <nova:ports>
Apr 11 17:17:22 user nova-compute[71063]:         <nova:port uuid="4ec17eb0-1b20-4679-9900-3fa2850b50b8">
Apr 11 17:17:22 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 17:17:22 user nova-compute[71063]:         </nova:port>
Apr 11 17:17:22 user nova-compute[71063]:       </nova:ports>
Apr 11 17:17:22 user nova-compute[71063]:     </nova:instance>
Apr 11 17:17:22 user nova-compute[71063]:   </metadata>
Apr 11 17:17:22 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:17:22 user nova-compute[71063]:     <system>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="serial">b5f9fe94-98f0-4094-8003-53c06cbfd5cb</entry>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="uuid">b5f9fe94-98f0-4094-8003-53c06cbfd5cb</entry>
Apr 11 17:17:22 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:17:22 user nova-compute[71063]:     </system>
Apr 11 17:17:22 user nova-compute[71063]:   </sysinfo>
Apr 11 17:17:22 user nova-compute[71063]:   <os>
Apr 11 17:17:22 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:17:22 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:17:22 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:17:22 user nova-compute[71063]:   </os>
Apr 11 17:17:22 user nova-compute[71063]:   <features>
Apr 11 17:17:22 user nova-compute[71063]:     <acpi/>
Apr 11 17:17:22 user nova-compute[71063]:     <apic/>
Apr 11 17:17:22 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:17:22 user nova-compute[71063]:   </features>
Apr 11 17:17:22 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:17:22 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:17:22 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:17:22 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:17:22 user nova-compute[71063]:   </clock>
Apr 11 17:17:22 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:17:22 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:17:22 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:17:22 user nova-compute[71063]:   </cpu>
Apr 11 17:17:22 user nova-compute[71063]:   <devices>
Apr 11 17:17:22 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:17:22 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:17:22 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk"/>
Apr 11 17:17:22 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:17:22 user nova-compute[71063]:     </disk>
Apr 11 17:17:22 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:17:22 user nova-compute[71063]:       <mac address="fa:16:3e:df:02:d7"/>
Apr 11 17:17:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:22 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:17:22 user nova-compute[71063]:       <target dev="tap4ec17eb0-1b"/>
Apr 11 17:17:22 user nova-compute[71063]:     </interface>
Apr 11 17:17:22 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:17:22 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/console.log" append="off"/>
Apr 11 17:17:22 user nova-compute[71063]:     </serial>
Apr 11 17:17:22 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:17:22 user nova-compute[71063]:     <video>
Apr 11 17:17:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:22 user nova-compute[71063]:     </video>
Apr 11 17:17:22 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:17:22 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:17:22 user nova-compute[71063]:     </rng>
Apr 11 17:17:22 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:17:22 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:17:22 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:17:22 user nova-compute[71063]:     </memballoon>
Apr 11 17:17:22 user nova-compute[71063]:   </devices>
Apr 11 17:17:22 user nova-compute[71063]: </domain>
Apr 11 17:17:22 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466344126',display_name='tempest-AttachVolumeNegativeTest-server-466344126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466344126',id=32,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIiVZRIcFyrvGPDYWVH2yITtiQzaRj2SywIZW4J28+dHZ1qwOIi5RhBpem8WI1Pb6Gr2152T3472CaYxEgZeL4HFHRz9zhJhhcmnLlUaTw8qfm4gEhwuOe1dDzwWwz76g==',key_name='tempest-keypair-1874843256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-jbbbs19g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=b5f9fe94-98f0-4094-8003-53c06cbfd5cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG os_vif [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ec17eb0-1b, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ec17eb0-1b, col_values=(('external_ids', {'iface-id': '4ec17eb0-1b20-4679-9900-3fa2850b50b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:02:d7', 'vm-uuid': 'b5f9fe94-98f0-4094-8003-53c06cbfd5cb'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:22 user nova-compute[71063]: INFO os_vif [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b')
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:df:02:d7, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:17:22 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updated VIF entry in instance network info cache for port b9d61f36-ee8c-4487-81e1-28d27592a092. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [{"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Releasing lock "refresh_cache-9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updated VIF entry in instance network info cache for port 4ec17eb0-1b20-4679-9900-3fa2850b50b8. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updating instance_info_cache with network_info: [{"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Releasing lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.935s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:24 user nova-compute[71063]: WARNING nova.compute.manager [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state building and task_state spawning.
Apr 11 17:17:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:17:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:26 user nova-compute[71063]: WARNING nova.compute.manager [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state building and task_state spawning.
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233446.7044082, b5f9fe94-98f0-4094-8003-53c06cbfd5cb => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] VM Resumed (Lifecycle Event)
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Instance spawned successfully.
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233446.7082071, b5f9fe94-98f0-4094-8003-53c06cbfd5cb => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] VM Started (Lifecycle Event)
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:26 user nova-compute[71063]: INFO nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Took 8.83 seconds to spawn the instance on the hypervisor.
Apr 11 17:17:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:27 user nova-compute[71063]: INFO nova.compute.manager [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Took 9.79 seconds to build instance.
Apr 11 17:17:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.893s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:17:32 user nova-compute[71063]: INFO nova.compute.claims [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Claim successful on node user
Apr 11 17:17:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:17:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.policy [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:17:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Creating image(s)
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "/opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "/opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.187s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk 1073741824" returned: 0 in 0.056s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.172s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking if we can resize image /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Cannot resize image /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'migration_context' on Instance uuid 70a306a5-f981-495f-9f3a-8fd5011b4ce1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Ensure instance console log exists: /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Successfully created port: 2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:17:34 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Successfully updated port: 2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing instance network info cache due to event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Instance network_info: |[{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Start _get_guest_xml network_info=[{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:17:35 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:35 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1640703286',display_name='tempest-ServerActionsTestJSON-server-1640703286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1640703286',id=33,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-zr190i4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=70a306a5-f981-495f-9f3a-8fd5011b4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 70a306a5-f981-495f-9f3a-8fd5011b4ce1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:17:35 user nova-compute[71063]:   <uuid>70a306a5-f981-495f-9f3a-8fd5011b4ce1</uuid>
Apr 11 17:17:35 user nova-compute[71063]:   <name>instance-00000021</name>
Apr 11 17:17:35 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:17:35 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:17:35 user nova-compute[71063]:   <metadata>
Apr 11 17:17:35 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:17:35 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-1640703286</nova:name>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:17:35</nova:creationTime>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:17:35 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:17:35 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:owner>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:17:35 user nova-compute[71063]:       </nova:owner>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:17:35 user nova-compute[71063]:       <nova:ports>
Apr 11 17:17:35 user nova-compute[71063]:         <nova:port uuid="2a3246a9-9ae1-4f3e-9e23-37c3702e9879">
Apr 11 17:17:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 17:17:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:17:35 user nova-compute[71063]:       </nova:ports>
Apr 11 17:17:35 user nova-compute[71063]:     </nova:instance>
Apr 11 17:17:35 user nova-compute[71063]:   </metadata>
Apr 11 17:17:35 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:17:35 user nova-compute[71063]:     <system>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="serial">70a306a5-f981-495f-9f3a-8fd5011b4ce1</entry>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="uuid">70a306a5-f981-495f-9f3a-8fd5011b4ce1</entry>
Apr 11 17:17:35 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:17:35 user nova-compute[71063]:     </system>
Apr 11 17:17:35 user nova-compute[71063]:   </sysinfo>
Apr 11 17:17:35 user nova-compute[71063]:   <os>
Apr 11 17:17:35 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:17:35 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:17:35 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:17:35 user nova-compute[71063]:   </os>
Apr 11 17:17:35 user nova-compute[71063]:   <features>
Apr 11 17:17:35 user nova-compute[71063]:     <acpi/>
Apr 11 17:17:35 user nova-compute[71063]:     <apic/>
Apr 11 17:17:35 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:17:35 user nova-compute[71063]:   </features>
Apr 11 17:17:35 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:17:35 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:17:35 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:17:35 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:17:35 user nova-compute[71063]:   </clock>
Apr 11 17:17:35 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:17:35 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:17:35 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:17:35 user nova-compute[71063]:   </cpu>
Apr 11 17:17:35 user nova-compute[71063]:   <devices>
Apr 11 17:17:35 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:17:35 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:17:35 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk"/>
Apr 11 17:17:35 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:17:35 user nova-compute[71063]:     </disk>
Apr 11 17:17:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:17:35 user nova-compute[71063]:       <mac address="fa:16:3e:5e:b3:2a"/>
Apr 11 17:17:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:17:35 user nova-compute[71063]:       <target dev="tap2a3246a9-9a"/>
Apr 11 17:17:35 user nova-compute[71063]:     </interface>
Apr 11 17:17:35 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:17:35 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/console.log" append="off"/>
Apr 11 17:17:35 user nova-compute[71063]:     </serial>
Apr 11 17:17:35 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:17:35 user nova-compute[71063]:     <video>
Apr 11 17:17:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:35 user nova-compute[71063]:     </video>
Apr 11 17:17:35 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:17:35 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:17:35 user nova-compute[71063]:     </rng>
Apr 11 17:17:35 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:17:35 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:17:35 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:17:35 user nova-compute[71063]:     </memballoon>
Apr 11 17:17:35 user nova-compute[71063]:   </devices>
Apr 11 17:17:35 user nova-compute[71063]: </domain>
Apr 11 17:17:35 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1640703286',display_name='tempest-ServerActionsTestJSON-server-1640703286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1640703286',id=33,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-zr190i4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=70a306a5-f981-495f-9f3a-8fd5011b4ce1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG os_vif [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a3246a9-9a, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a3246a9-9a, col_values=(('external_ids', {'iface-id': '2a3246a9-9ae1-4f3e-9e23-37c3702e9879', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:b3:2a', 'vm-uuid': '70a306a5-f981-495f-9f3a-8fd5011b4ce1'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:35 user nova-compute[71063]: INFO os_vif [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a')
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:5e:b3:2a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updated VIF entry in instance network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] No waiting events found dispatching network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:37 user nova-compute[71063]: WARNING nova.compute.manager [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received unexpected event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance with vm_state building and task_state spawning.
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:17:37 user nova-compute[71063]: INFO nova.compute.claims [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Claim successful on node user
Apr 11 17:17:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:17:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:17:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.policy [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:17:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Creating image(s)
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.part --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.virt.images [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] f3215b4d-2cf9-4d8a-97ac-d18798f8f815 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.part /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.part /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.converted" returned: 0 in 0.233s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Successfully created port: ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.809s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2,backing_fmt=raw /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2,backing_fmt=raw /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk 1073741824" returned: 0 in 0.052s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "abc645818b6c6f91bed04fc23128ec655b4d3bd2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233459.2797976, 70a306a5-f981-495f-9f3a-8fd5011b4ce1 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] VM Resumed (Lifecycle Event)
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Instance spawned successfully.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] No waiting events found dispatching network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:39 user nova-compute[71063]: WARNING nova.compute.manager [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received unexpected event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance with vm_state building and task_state spawning.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233459.2807202, 70a306a5-f981-495f-9f3a-8fd5011b4ce1 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] VM Started (Lifecycle Event)
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Successfully updated port: ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Cannot resize image /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'migration_context' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Ensure instance console log exists: /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:39 user nova-compute[71063]: INFO nova.compute.manager [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Took 7.21 seconds to build instance.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing instance network info cache due to event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.339s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance network_info: |[{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start _get_guest_xml network_info=[{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:17:34Z,direct_url=<?>,disk_format='qcow2',id=f3215b4d-2cf9-4d8a-97ac-d18798f8f815,min_disk=0,min_ram=0,name='tempest-scenario-img--338262030',owner='ab7ce3fc251f4f1eb9151d1ef8c86d91',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:17:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f3215b4d-2cf9-4d8a-97ac-d18798f8f815'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:17:39 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:39 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:17:34Z,direct_url=<?>,disk_format='qcow2',id=f3215b4d-2cf9-4d8a-97ac-d18798f8f815,min_disk=0,min_ram=0,name='tempest-scenario-img--338262030',owner='ab7ce3fc251f4f1eb9151d1ef8c86d91',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:17:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:17:39 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:38Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:17:40 user nova-compute[71063]:   <uuid>9bf98306-a141-480b-97c0-6fdd7931b8f6</uuid>
Apr 11 17:17:40 user nova-compute[71063]:   <name>instance-00000022</name>
Apr 11 17:17:40 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:17:40 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:17:40 user nova-compute[71063]:   <metadata>
Apr 11 17:17:40 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:17:40 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:name>tempest-TestMinimumBasicScenario-server-728641310</nova:name>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:17:39</nova:creationTime>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:17:40 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:17:40 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:owner>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:user uuid="eed61e2d73a84d85a9f5ff2b314624c9">tempest-TestMinimumBasicScenario-593818068-project-member</nova:user>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:project uuid="ab7ce3fc251f4f1eb9151d1ef8c86d91">tempest-TestMinimumBasicScenario-593818068</nova:project>
Apr 11 17:17:40 user nova-compute[71063]:       </nova:owner>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:root type="image" uuid="f3215b4d-2cf9-4d8a-97ac-d18798f8f815"/>
Apr 11 17:17:40 user nova-compute[71063]:       <nova:ports>
Apr 11 17:17:40 user nova-compute[71063]:         <nova:port uuid="ef4e04c8-3073-425e-a10b-ca224239fd2f">
Apr 11 17:17:40 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 17:17:40 user nova-compute[71063]:         </nova:port>
Apr 11 17:17:40 user nova-compute[71063]:       </nova:ports>
Apr 11 17:17:40 user nova-compute[71063]:     </nova:instance>
Apr 11 17:17:40 user nova-compute[71063]:   </metadata>
Apr 11 17:17:40 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:17:40 user nova-compute[71063]:     <system>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="serial">9bf98306-a141-480b-97c0-6fdd7931b8f6</entry>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="uuid">9bf98306-a141-480b-97c0-6fdd7931b8f6</entry>
Apr 11 17:17:40 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:17:40 user nova-compute[71063]:     </system>
Apr 11 17:17:40 user nova-compute[71063]:   </sysinfo>
Apr 11 17:17:40 user nova-compute[71063]:   <os>
Apr 11 17:17:40 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:17:40 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:17:40 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:17:40 user nova-compute[71063]:   </os>
Apr 11 17:17:40 user nova-compute[71063]:   <features>
Apr 11 17:17:40 user nova-compute[71063]:     <acpi/>
Apr 11 17:17:40 user nova-compute[71063]:     <apic/>
Apr 11 17:17:40 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:17:40 user nova-compute[71063]:   </features>
Apr 11 17:17:40 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:17:40 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:17:40 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:17:40 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:17:40 user nova-compute[71063]:   </clock>
Apr 11 17:17:40 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:17:40 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:17:40 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:17:40 user nova-compute[71063]:   </cpu>
Apr 11 17:17:40 user nova-compute[71063]:   <devices>
Apr 11 17:17:40 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:17:40 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:17:40 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk"/>
Apr 11 17:17:40 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:17:40 user nova-compute[71063]:     </disk>
Apr 11 17:17:40 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:17:40 user nova-compute[71063]:       <mac address="fa:16:3e:71:16:a5"/>
Apr 11 17:17:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:40 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:17:40 user nova-compute[71063]:       <target dev="tapef4e04c8-30"/>
Apr 11 17:17:40 user nova-compute[71063]:     </interface>
Apr 11 17:17:40 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:17:40 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/console.log" append="off"/>
Apr 11 17:17:40 user nova-compute[71063]:     </serial>
Apr 11 17:17:40 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:17:40 user nova-compute[71063]:     <video>
Apr 11 17:17:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:17:40 user nova-compute[71063]:     </video>
Apr 11 17:17:40 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:17:40 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:17:40 user nova-compute[71063]:     </rng>
Apr 11 17:17:40 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:17:40 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:17:40 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:17:40 user nova-compute[71063]:     </memballoon>
Apr 11 17:17:40 user nova-compute[71063]:   </devices>
Apr 11 17:17:40 user nova-compute[71063]: </domain>
Apr 11 17:17:40 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:17:38Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG os_vif [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef4e04c8-30, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef4e04c8-30, col_values=(('external_ids', {'iface-id': 'ef4e04c8-3073-425e-a10b-ca224239fd2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:16:a5', 'vm-uuid': '9bf98306-a141-480b-97c0-6fdd7931b8f6'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:40 user nova-compute[71063]: INFO os_vif [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30')
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No VIF found with MAC fa:16:3e:71:16:a5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updated VIF entry in instance network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:17:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:41 user nova-compute[71063]: WARNING nova.compute.manager [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state building and task_state spawning.
Apr 11 17:17:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233463.7949939, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] VM Resumed (Lifecycle Event)
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance spawned successfully.
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233463.7980375, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] VM Started (Lifecycle Event)
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:17:43 user nova-compute[71063]: WARNING nova.compute.manager [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state building and task_state spawning.
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Took 5.78 seconds to spawn the instance on the hypervisor.
Apr 11 17:17:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:17:43 user nova-compute[71063]: INFO nova.compute.manager [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Took 6.69 seconds to build instance.
Apr 11 17:17:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:17:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:17:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [{"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-58e3bca8-f38a-45d1-98c2-06391f9f31fd" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:18:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:18:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:11 user nova-compute[71063]: INFO nova.compute.manager [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Terminating instance
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-unplugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Instance destroyed successfully.
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-579308500',display_name='tempest-ServerRescueNegativeTestJSON-server-579308500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-579308500',id=24,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGkKTLlyaiNlgTA/a3+wQJKjlfUlqxOhcZof+ak5elUWRWmgYc/CbiNKCyQuPLIMAq91lRafTJCTDR90vug4Xdnzc+pbfBDvuS8gBnQ8lxmDuXBq11y3jCZxiBHnPd13g==',key_name='tempest-keypair-896312461',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:13:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-5q306noz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3666d19053684843b400aab6ebf29cce',uuid=9e213b9c-23c4-4fe4-bd2f-2443ee3628bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b9d61f36-ee8c-4487-81e1-28d27592a092", "address": "fa:16:3e:f6:6e:38", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9d61f36-ee", "ovs_interfaceid": "b9d61f36-ee8c-4487-81e1-28d27592a092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG os_vif [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9d61f36-ee, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:18:11 user nova-compute[71063]: INFO os_vif [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:6e:38,bridge_name='br-int',has_traffic_filtering=True,id=b9d61f36-ee8c-4487-81e1-28d27592a092,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9d61f36-ee')
Apr 11 17:18:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Deleting instance files /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc_del
Apr 11 17:18:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Deletion of /opt/stack/data/nova/instances/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc_del complete
Apr 11 17:18:11 user nova-compute[71063]: INFO nova.compute.manager [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 17:18:11 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:18:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:18:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:18:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Took 0.70 seconds to deallocate network for instance.
Apr 11 17:18:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-deleted-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:13 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Deleted allocations for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Acquiring lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Lock "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] No waiting events found dispatching network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:13 user nova-compute[71063]: WARNING nova.compute.manager [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Received unexpected event network-vif-plugged-b9d61f36-ee8c-4487-81e1-28d27592a092 for instance with vm_state deleted and task_state None.
Apr 11 17:18:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:18:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:18:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:18:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7591MB free_disk=26.13930892944336GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:18:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:23 user nova-compute[71063]: INFO nova.compute.manager [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Unshelving
Apr 11 17:18:23 user nova-compute[71063]: INFO nova.virt.block_device [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Booting with volume 5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b at /dev/vdc
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b3b561-9929-4311-9a4b-41d5401b5d1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b25db-056b-4919-9447-55107fe5f4cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc065db-1beb-4750-a2b3-03bc2880f469]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d45e80-9a9f-4a99-9152-4b83f3842921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:18:23 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:18:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec7857-8e99-4639-aa90-c1c2fef0df64]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:18:23 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating existing volume attachment record: 4152695c-4dea-430f-a0fa-da2748375dd6 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:18:26 user nova-compute[71063]: INFO nova.compute.manager [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Unrescuing
Apr 11 17:18:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquired lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [{"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Releasing lock "refresh_cache-85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG nova.objects.instance [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'flavor' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233491.8942351, 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:18:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] VM Stopped (Lifecycle Event)
Apr 11 17:18:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-f9291795-ac75-41dd-a8f7-8fc1420b2768 None None] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:27 user nova-compute[71063]: WARNING nova.compute.manager [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:18:27 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance destroyed successfully.
Apr 11 17:18:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_requests' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'numa_topology' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:18:28 user nova-compute[71063]: INFO nova.compute.claims [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Claim successful on node user
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:28 user nova-compute[71063]: INFO nova.network.neutron [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:29 user nova-compute[71063]: WARNING nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:29 user nova-compute[71063]: WARNING nova.compute.manager [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state rescued and task_state unrescuing.
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing instance network info cache due to event network-changed-4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:18:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Acquiring lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:18:30 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Creating image(s)
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'trusted_certs' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Acquired lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG nova.network.neutron [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Refreshing network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233511.046954, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:18:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Resumed (Lifecycle Event)
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.virt.images [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 6beaf0d5-984f-4806-8985-dcd7e82ccaf4 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.part /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233511.0471637, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:18:31 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Started (Lifecycle Event)
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.part /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.converted" returned: 0 in 0.194s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.compute.manager [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:31 user nova-compute[71063]: WARNING nova.compute.manager [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state None.
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updated VIF entry in instance network info cache for port 4d7d89bc-13fc-41ae-b35c-618cc375d3b4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG nova.network.neutron [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.341s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Releasing lock "refresh_cache-49e044ae-91af-4db8-b0fe-3679dd210ab2" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b,backing_fmt=raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b,backing_fmt=raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk 1073741824" returned: 0 in 0.054s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "3ea7c09bfabac53ec8053b904503420c1a64f55b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3ea7c09bfabac53ec8053b904503420c1a64f55b --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'migration_context' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Rebasing disk image.
Apr 11 17:18:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 -F raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 -F raw /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk" returned: 0 in 2.440s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Ensure instance console log exists: /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start _get_guest_xml network_info=[{"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='29105999957cea40c24dcf61bb435caf',container_format='bare',created_at=2023-04-11T17:16:31Z,direct_url=<?>,disk_format='qcow2',id=6beaf0d5-984f-4806-8985-dcd7e82ccaf4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2104871241-shelved',owner='fce268052b8046e5a7efa41048e96645',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T17:16:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'attachment_id': '4152695c-4dea-430f-a0fa-da2748375dd6', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLmBnMCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '49e044ae-91af-4db8-b0fe-3679dd210ab2', 'attached_at': '', 'detached_at': '', 'volume_id': '5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 'serial': '5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:18:34 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:18:34 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='29105999957cea40c24dcf61bb435caf',container_format='bare',created_at=2023-04-11T17:16:31Z,direct_url=<?>,disk_format='qcow2',id=6beaf0d5-984f-4806-8985-dcd7e82ccaf4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2104871241-shelved',owner='fce268052b8046e5a7efa41048e96645',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T17:16:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'vcpu_model' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLmBnMCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:18:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:18:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:18:34 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a5a4b-efdf-4f1a-8b24-46fa0fa70a29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:18:34 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909e33e-7f81-4e49-a711-1bf147dd07e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b] added
Apr 11 17:18:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[073a3b28-d948-40dc-a65e-7d117b26bc59]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2590db6a-d3c2-475e-9131-e886214b3ae1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLmBnMCx {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SLmBnMCx" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[54622d6e-4bd1-4c7e-b3a5-f68ed817bacf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SLmBnMCx'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9dde2b-9ef3-45a1-b68c-7f01963cb19d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[661955d2-1afb-43d0-af87-f5e3c50b3473]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:34 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb1c89-f246-4dcf-ba93-e8e9c5c96c2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260]
Apr 11 17:18:34 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260] successful.
Apr 11 17:18:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4482e834-d9ae-4424-97e5-e2caa5fe86d0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e721d3-cc5f-401d-9569-72824645fd0e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:18:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:35 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:18:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[860563ea-770f-4af1-a692-dc183c57f996]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLmBnMCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26434336432316437', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434336432316437', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='6beaf0d5-984f-4806-8985-dcd7e82ccaf4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-385713192',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:16:34.378433',shelved_host='user',shelved_image_id='6beaf0d5-984f-4806-8985-dcd7e82ccaf4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_devices' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:18:36 user nova-compute[71063]:   <uuid>49e044ae-91af-4db8-b0fe-3679dd210ab2</uuid>
Apr 11 17:18:36 user nova-compute[71063]:   <name>instance-0000001c</name>
Apr 11 17:18:36 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:18:36 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:18:36 user nova-compute[71063]:   <metadata>
Apr 11 17:18:36 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:18:36 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2104871241</nova:name>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:18:34</nova:creationTime>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:18:36 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:18:36 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:owner>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:user uuid="b69069a1461d485598e2078cc12772a5">tempest-AttachVolumeShelveTestJSON-2051096798-project-member</nova:user>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:project uuid="fce268052b8046e5a7efa41048e96645">tempest-AttachVolumeShelveTestJSON-2051096798</nova:project>
Apr 11 17:18:36 user nova-compute[71063]:       </nova:owner>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:root type="image" uuid="6beaf0d5-984f-4806-8985-dcd7e82ccaf4"/>
Apr 11 17:18:36 user nova-compute[71063]:       <nova:ports>
Apr 11 17:18:36 user nova-compute[71063]:         <nova:port uuid="4d7d89bc-13fc-41ae-b35c-618cc375d3b4">
Apr 11 17:18:36 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:18:36 user nova-compute[71063]:         </nova:port>
Apr 11 17:18:36 user nova-compute[71063]:       </nova:ports>
Apr 11 17:18:36 user nova-compute[71063]:     </nova:instance>
Apr 11 17:18:36 user nova-compute[71063]:   </metadata>
Apr 11 17:18:36 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:18:36 user nova-compute[71063]:     <system>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="serial">49e044ae-91af-4db8-b0fe-3679dd210ab2</entry>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="uuid">49e044ae-91af-4db8-b0fe-3679dd210ab2</entry>
Apr 11 17:18:36 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:18:36 user nova-compute[71063]:     </system>
Apr 11 17:18:36 user nova-compute[71063]:   </sysinfo>
Apr 11 17:18:36 user nova-compute[71063]:   <os>
Apr 11 17:18:36 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:18:36 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:18:36 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:18:36 user nova-compute[71063]:   </os>
Apr 11 17:18:36 user nova-compute[71063]:   <features>
Apr 11 17:18:36 user nova-compute[71063]:     <acpi/>
Apr 11 17:18:36 user nova-compute[71063]:     <apic/>
Apr 11 17:18:36 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:18:36 user nova-compute[71063]:   </features>
Apr 11 17:18:36 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:18:36 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:18:36 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:18:36 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:18:36 user nova-compute[71063]:   </clock>
Apr 11 17:18:36 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:18:36 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:18:36 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:18:36 user nova-compute[71063]:   </cpu>
Apr 11 17:18:36 user nova-compute[71063]:   <devices>
Apr 11 17:18:36 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:18:36 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:18:36 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk"/>
Apr 11 17:18:36 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:18:36 user nova-compute[71063]:     </disk>
Apr 11 17:18:36 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:18:36 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:18:36 user nova-compute[71063]:       <source dev="/dev/sdc"/>
Apr 11 17:18:36 user nova-compute[71063]:       <target dev="vdc" bus="virtio"/>
Apr 11 17:18:36 user nova-compute[71063]:       <serial>5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b</serial>
Apr 11 17:18:36 user nova-compute[71063]:     </disk>
Apr 11 17:18:36 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:18:36 user nova-compute[71063]:       <mac address="fa:16:3e:35:10:e5"/>
Apr 11 17:18:36 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:18:36 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:18:36 user nova-compute[71063]:       <target dev="tap4d7d89bc-13"/>
Apr 11 17:18:36 user nova-compute[71063]:     </interface>
Apr 11 17:18:36 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:18:36 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/console.log" append="off"/>
Apr 11 17:18:36 user nova-compute[71063]:     </serial>
Apr 11 17:18:36 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:18:36 user nova-compute[71063]:     <video>
Apr 11 17:18:36 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:18:36 user nova-compute[71063]:     </video>
Apr 11 17:18:36 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:18:36 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:18:36 user nova-compute[71063]:     </rng>
Apr 11 17:18:36 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:18:36 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:18:36 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:18:36 user nova-compute[71063]:     </memballoon>
Apr 11 17:18:36 user nova-compute[71063]:   </devices>
Apr 11 17:18:36 user nova-compute[71063]: </domain>
Apr 11 17:18:36 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='6beaf0d5-984f-4806-8985-dcd7e82ccaf4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-385713192',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:16:34.378433',shelved_host='user',shelved_image_id='6beaf0d5-984f-4806-8985-dcd7e82ccaf4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG os_vif [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d7d89bc-13, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d7d89bc-13, col_values=(('external_ids', {'iface-id': '4d7d89bc-13fc-41ae-b35c-618cc375d3b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:10:e5', 'vm-uuid': '49e044ae-91af-4db8-b0fe-3679dd210ab2'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:36 user nova-compute[71063]: INFO os_vif [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13')
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:18:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No VIF found with MAC fa:16:3e:35:10:e5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:37 user nova-compute[71063]: WARNING nova.compute.manager [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:18:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233519.754295, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:18:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Resumed (Lifecycle Event)
Apr 11 17:18:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance spawned successfully.
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:18:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233519.7543967, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:18:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Started (Lifecycle Event)
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:18:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:39 user nova-compute[71063]: WARNING nova.compute.manager [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:18:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:18:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.655s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:55 user nova-compute[71063]: INFO nova.compute.manager [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Terminating instance
Apr 11 17:18:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-unplugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] No waiting events found dispatching network-vif-unplugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-unplugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:18:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Instance destroyed successfully.
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid d0b8cd04-945b-4926-b7fb-b6c65ed0164d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-526047112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-526047112',id=31,image_ref='273f8606-84b3-45d3-b376-88cb98e870e6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-pzo3yegv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-665298870',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:17:21Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=d0b8cd04-945b-4926-b7fb-b6c65ed0164d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "address": "fa:16:3e:10:db:bf", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace52784-2f", "ovs_interfaceid": "ace52784-2fcb-440a-8ff5-4fa05c330f9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_vif [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapace52784-2f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:18:56 user nova-compute[71063]: INFO os_vif [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:db:bf,bridge_name='br-int',has_traffic_filtering=True,id=ace52784-2fcb-440a-8ff5-4fa05c330f9b,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace52784-2f')
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VgoeSXli', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:18:56 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89eb430-d7bd-4ad4-b19f-c5c1fa0847f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:18:56 user nova-compute[71063]: No targets found.
Apr 11 17:18:56 user nova-compute[71063]: iSNS:
Apr 11 17:18:56 user nova-compute[71063]: No targets found.
Apr 11 17:18:56 user nova-compute[71063]: STATIC:
Apr 11 17:18:56 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:18:56 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:18:56 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:18:56 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5
Apr 11 17:18:56 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:18:56 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:18:56 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:18:56 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:18:56 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:18:56 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b
Apr 11 17:18:56 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:18:56 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:18:56 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:18:56 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:18:56 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:18:56 user nova-compute[71063]: FIRMWARE:
Apr 11 17:18:56 user nova-compute[71063]: No targets found.
Apr 11 17:18:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:18:56 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:18:56 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0112502f-fe0f-4590-a0ca-bf22f603b480]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[db06ada9-9ff0-48bc-8f9b-2c34df21c834]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:18:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 (non-flash)
Apr 11 17:18:56 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:18:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe804ae320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf909f99-0656-49c6-af18-6e7e8bf111e0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[73386e86-172f-4823-a70a-12bfbdcfdd86]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c5d8ee-554f-49d8-9eb3-258d2671adeb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b30988-d3f3-4cb8-9594-d9fb5e2ecbad]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO57921c4c-6e22c41ad89ebf42', '/dev/disk/by-id/scsi-23665323263343161', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_57921c4c') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee973377-be51-4f84-97e2-47d21e8b9b4b]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd072f5-870f-466a-83f9-dd8f6321c750]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d795b-7a03-4189-a95b-aae33513e295]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260]
Apr 11 17:18:56 user nova-compute[71063]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5, portal: 172.16.0.220,3260] successful.
Apr 11 17:18:56 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebe8205-7962-41ed-8b8d-b8853c2b1d0b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (337ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:18:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Deleting instance files /opt/stack/data/nova/instances/d0b8cd04-945b-4926-b7fb-b6c65ed0164d_del
Apr 11 17:18:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Deletion of /opt/stack/data/nova/instances/d0b8cd04-945b-4926-b7fb-b6c65ed0164d_del complete
Apr 11 17:18:56 user nova-compute[71063]: INFO nova.compute.manager [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 11 17:18:56 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:18:56 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:57 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Took 0.48 seconds to deallocate network for instance.
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-deleted-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:57 user nova-compute[71063]: INFO nova.compute.manager [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Neutron deleted interface ace52784-2fcb-440a-8ff5-4fa05c330f9b; detaching it from the instance and deleting it from the info cache
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.network.neutron [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Detach interface failed, port_id=ace52784-2fcb-440a-8ff5-4fa05c330f9b, reason: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Acquiring lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] No waiting events found dispatching network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:18:57 user nova-compute[71063]: WARNING nova.compute.manager [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Received unexpected event network-vif-plugged-ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance with vm_state active and task_state deleting.
Apr 11 17:18:57 user nova-compute[71063]: INFO nova.compute.manager [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Took 0.87 seconds to detach 1 volumes for instance.
Apr 11 17:18:57 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Deleting volume: f8efb73f-45cb-4cab-b65a-dd2e3900e4c5 {{(pid=71063) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:18:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:58 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d
Apr 11 17:18:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "d0b8cd04-945b-4926-b7fb-b6c65ed0164d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.193s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:18:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:04 user nova-compute[71063]: INFO nova.compute.manager [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Terminating instance
Apr 11 17:19:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-unplugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Instance destroyed successfully.
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.objects.instance [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1242455481',display_name='tempest-ServerRescueNegativeTestJSON-server-1242455481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1242455481',id=3,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:05:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-ia8pkgh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:05:06Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=58e3bca8-f38a-45d1-98c2-06391f9f31fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "153bd902-5486-49d7-8f56-9ac648664124", "address": "fa:16:3e:0d:c9:1a", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap153bd902-54", "ovs_interfaceid": "153bd902-5486-49d7-8f56-9ac648664124", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG os_vif [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap153bd902-54, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:19:05 user nova-compute[71063]: INFO os_vif [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:c9:1a,bridge_name='br-int',has_traffic_filtering=True,id=153bd902-5486-49d7-8f56-9ac648664124,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap153bd902-54')
Apr 11 17:19:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Deleting instance files /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd_del
Apr 11 17:19:05 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Deletion of /opt/stack/data/nova/instances/58e3bca8-f38a-45d1-98c2-06391f9f31fd_del complete
Apr 11 17:19:05 user nova-compute[71063]: INFO nova.compute.manager [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 17:19:05 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:19:05 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:06 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Took 0.44 seconds to deallocate network for instance.
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-deleted-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:06 user nova-compute[71063]: INFO nova.compute.manager [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Neutron deleted interface 153bd902-5486-49d7-8f56-9ac648664124; detaching it from the instance and deleting it from the info cache
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.network.neutron [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Detach interface failed, port_id=153bd902-5486-49d7-8f56-9ac648664124, reason: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:06 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Deleted allocations for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd
Apr 11 17:19:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Acquiring lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Lock "58e3bca8-f38a-45d1-98c2-06391f9f31fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] No waiting events found dispatching network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:07 user nova-compute[71063]: WARNING nova.compute.manager [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Received unexpected event network-vif-plugged-153bd902-5486-49d7-8f56-9ac648664124 for instance with vm_state deleted and task_state None.
Apr 11 17:19:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-changed-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Refreshing instance network info cache due to event network-changed-4ec17eb0-1b20-4679-9900-3fa2850b50b8. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Acquiring lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Acquired lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.network.neutron [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Refreshing network info cache for port 4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.network.neutron [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updated VIF entry in instance network info cache for port 4ec17eb0-1b20-4679-9900-3fa2850b50b8. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.network.neutron [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updating instance_info_cache with network_info: [{"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Releasing lock "refresh_cache-b5f9fe94-98f0-4094-8003-53c06cbfd5cb" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:09 user nova-compute[71063]: INFO nova.compute.manager [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Attaching volume 6b9154d8-9977-4c02-89a1-26975750e0a5 to /dev/vdb
Apr 11 17:19:09 user nova-compute[71063]: DEBUG os_brick.utils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:09 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b3077-fd5d-49e3-8a14-460341c1a683]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda78e36-a0f7-4808-bf6e-c22e7c59a390]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71917fd-34de-44c4-94ae-a2a0d7e4123b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dbc4e9-8ca3-4b22-9198-237bb400aeca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:10 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e355443-1db6-41ad-b90f-3c9f8890be66]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG os_brick.utils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updating existing volume attachment record: 3ba604a2-8774-44e1-8fb8-2eb18498353f {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:19:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:11 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233536.0875146, d0b8cd04-945b-4926-b7fb-b6c65ed0164d => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:11 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] VM Stopped (Lifecycle Event)
Apr 11 17:19:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4d927652-f562-4067-9384-3cdd9474d95a None None] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:19:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBPFJrnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:14 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:14 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:14 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70826f8-2a55-4c0e-8e8e-8d52f5f7edcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:19:14 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4711f50-e5bb-4a49-a67d-e60f02de697d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5] added
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041aa4c-b373-4cc4-9b3f-4eb34141241e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8bac1e-5fa3-4971-bad1-526012962300]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBPFJrnu {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBPFJrnu" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774e167-00c9-4f35-b16b-75b5d27302c8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBPFJrnu'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075cb80-c90f-4b5f-b937-871b8c8a5638]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743fa96-970f-4629-b466-cec5c178b1a2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1cade9-caba-40aa-8cdb-7686be76b2df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260]
Apr 11 17:19:14 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[848a1d59-f1a8-41ab-835e-f1bab6aa903e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003fece-3c25-40e7-9651-87e4e7e684d1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:14 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[288db762-9e51-4751-b81f-8311bac78a8b]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:19:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBPFJrnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26236303432376561', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236303432376561', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:19:15 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:19:15 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:19:15 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:19:15 user nova-compute[71063]:   <serial>6b9154d8-9977-4c02-89a1-26975750e0a5</serial>
Apr 11 17:19:15 user nova-compute[71063]: </disk>
Apr 11 17:19:15 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:15 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:df:02:d7, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:19:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.108s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:19:19 user nova-compute[71063]: INFO nova.compute.claims [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Claim successful on node user
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.765s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:19:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233545.5569463, 58e3bca8-f38a-45d1-98c2-06391f9f31fd => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:20 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] VM Stopped (Lifecycle Event)
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2750809a-495c-42b1-858b-40fe05f5f15e None None] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.policy [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:19:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Creating image(s)
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk 1073741824" returned: 0 in 0.051s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Successfully created port: 714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Cannot resize image /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'migration_context' on Instance uuid 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Ensure instance console log exists: /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Successfully updated port: 714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:19:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=26.15760040283203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquired lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-changed-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Refreshing instance network info cache due to event network-changed-714e84f4-64ee-4448-9681-881a322ec1a8. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Acquiring lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 25935a69-292b-4d55-932c-f4893838998c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updating instance_info_cache with network_info: [{"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Releasing lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Instance network_info: |[{"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Acquired lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Refreshing network info cache for port 714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Start _get_guest_xml network_info=[{"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:19:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859055886',display_name='tempest-AttachVolumeNegativeTest-server-859055886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859055886',id=35,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCuqLGitNmsyVl6DZ1ST80abe9aOW0E48/T6TICTipu2zcFtu5oS+mkIEMmnW66SQRO+/LAO1Q8Zo0FD1QUJVbuMdMPql+IgEKelMKNrv1CNM86lLuJwhRYOR7Ri5AxeA==',key_name='tempest-keypair-1047793130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-nu17zxgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:19:22 user nova-compute[71063]:   <uuid>0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc</uuid>
Apr 11 17:19:22 user nova-compute[71063]:   <name>instance-00000023</name>
Apr 11 17:19:22 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:19:22 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:19:22 user nova-compute[71063]:   <metadata>
Apr 11 17:19:22 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:19:22 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeNegativeTest-server-859055886</nova:name>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:19:22</nova:creationTime>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:19:22 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:19:22 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:owner>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:user uuid="ff27d08254f74491aba3386c9b901300">tempest-AttachVolumeNegativeTest-1862265490-project-member</nova:user>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:project uuid="23c663a759724bbda32f189ceedf6675">tempest-AttachVolumeNegativeTest-1862265490</nova:project>
Apr 11 17:19:22 user nova-compute[71063]:       </nova:owner>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:19:22 user nova-compute[71063]:       <nova:ports>
Apr 11 17:19:22 user nova-compute[71063]:         <nova:port uuid="714e84f4-64ee-4448-9681-881a322ec1a8">
Apr 11 17:19:22 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 17:19:22 user nova-compute[71063]:         </nova:port>
Apr 11 17:19:22 user nova-compute[71063]:       </nova:ports>
Apr 11 17:19:22 user nova-compute[71063]:     </nova:instance>
Apr 11 17:19:22 user nova-compute[71063]:   </metadata>
Apr 11 17:19:22 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:19:22 user nova-compute[71063]:     <system>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="serial">0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc</entry>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="uuid">0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc</entry>
Apr 11 17:19:22 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:19:22 user nova-compute[71063]:     </system>
Apr 11 17:19:22 user nova-compute[71063]:   </sysinfo>
Apr 11 17:19:22 user nova-compute[71063]:   <os>
Apr 11 17:19:22 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:19:22 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:19:22 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:19:22 user nova-compute[71063]:   </os>
Apr 11 17:19:22 user nova-compute[71063]:   <features>
Apr 11 17:19:22 user nova-compute[71063]:     <acpi/>
Apr 11 17:19:22 user nova-compute[71063]:     <apic/>
Apr 11 17:19:22 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:19:22 user nova-compute[71063]:   </features>
Apr 11 17:19:22 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:19:22 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:19:22 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:19:22 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:19:22 user nova-compute[71063]:   </clock>
Apr 11 17:19:22 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:19:22 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:19:22 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:19:22 user nova-compute[71063]:   </cpu>
Apr 11 17:19:22 user nova-compute[71063]:   <devices>
Apr 11 17:19:22 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:19:22 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:19:22 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk"/>
Apr 11 17:19:22 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:19:22 user nova-compute[71063]:     </disk>
Apr 11 17:19:22 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:19:22 user nova-compute[71063]:       <mac address="fa:16:3e:bc:6d:3a"/>
Apr 11 17:19:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:22 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:19:22 user nova-compute[71063]:       <target dev="tap714e84f4-64"/>
Apr 11 17:19:22 user nova-compute[71063]:     </interface>
Apr 11 17:19:22 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:19:22 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/console.log" append="off"/>
Apr 11 17:19:22 user nova-compute[71063]:     </serial>
Apr 11 17:19:22 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:19:22 user nova-compute[71063]:     <video>
Apr 11 17:19:22 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:22 user nova-compute[71063]:     </video>
Apr 11 17:19:22 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:19:22 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:19:22 user nova-compute[71063]:     </rng>
Apr 11 17:19:22 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:19:22 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:19:22 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:19:22 user nova-compute[71063]:     </memballoon>
Apr 11 17:19:22 user nova-compute[71063]:   </devices>
Apr 11 17:19:22 user nova-compute[71063]: </domain>
Apr 11 17:19:22 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859055886',display_name='tempest-AttachVolumeNegativeTest-server-859055886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859055886',id=35,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCuqLGitNmsyVl6DZ1ST80abe9aOW0E48/T6TICTipu2zcFtu5oS+mkIEMmnW66SQRO+/LAO1Q8Zo0FD1QUJVbuMdMPql+IgEKelMKNrv1CNM86lLuJwhRYOR7Ri5AxeA==',key_name='tempest-keypair-1047793130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-nu17zxgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG os_vif [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap714e84f4-64, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap714e84f4-64, col_values=(('external_ids', {'iface-id': '714e84f4-64ee-4448-9681-881a322ec1a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:6d:3a', 'vm-uuid': '0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:22 user nova-compute[71063]: INFO os_vif [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64')
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:bc:6d:3a, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:19:22 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.163s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updated VIF entry in instance network info cache for port 714e84f4-64ee-4448-9681-881a322ec1a8. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updating instance_info_cache with network_info: [{"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Releasing lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing instance network info cache due to event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updated VIF entry in instance network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] No waiting events found dispatching network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:26 user nova-compute[71063]: WARNING nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received unexpected event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 for instance with vm_state building and task_state spawning.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] No waiting events found dispatching network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:26 user nova-compute[71063]: WARNING nova.compute.manager [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received unexpected event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 for instance with vm_state building and task_state spawning.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.claims [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Claim successful on node user
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233566.7343385, 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] VM Resumed (Lifecycle Event)
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Instance spawned successfully.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233566.737431, 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] VM Started (Lifecycle Event)
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:26 user nova-compute[71063]: INFO nova.compute.manager [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Took 7.51 seconds to build instance.
Apr 11 17:19:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.639s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:26 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.630s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:19:27 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:19:27 user nova-compute[71063]: INFO nova.virt.block_device [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Booting with volume 2bead45a-38fa-42b7-bd54-8c1f88c67e01 at /dev/vda
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.utils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.policy [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6484e3-a161-4df8-853f-d3fd6e8e3da0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0967c1b-7d80-4634-9873-b58c1cfd5629]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[57df4201-d465-432a-95c7-0877923b08e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b99aad-c27b-4981-acfd-2309fc76fe86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:27 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:19:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4ec8a-2b18-4518-a47f-2cb9a6932a53]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG os_brick.utils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating existing volume attachment record: 1484c669-8b2e-4efc-8eff-c4325e2a19ad {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:19:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Successfully created port: 09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Successfully updated port: 09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-changed-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Refreshing instance network info cache due to event network-changed-09360ccd-e24b-449a-9e15-b86a5a12b501. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance network_info: |[{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Refreshing network info cache for port 09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:29 user nova-compute[71063]: INFO nova.compute.manager [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Attaching volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 to /dev/vdb
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[78286af5-d8aa-401c-85e2-cd21250c0e71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad236ce-cd06-49eb-a2e6-5d15c041ab94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d707d3-f6ba-465e-8f29-e4c823059dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef51f4e-1bf3-428b-a5cb-dd7d754a50c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updated VIF entry in instance network info cache for port 09360ccd-e24b-449a-9e15-b86a5a12b501. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:19:29 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368a857-ee7d-4bfd-96b3-eab0c97e2c55]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating existing volume attachment record: aadd95c0-b9db-4c4e-a478-73c241865eda {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:19:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:19:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Creating image(s)
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Ensure instance console log exists: /opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start _get_guest_xml network_info=[{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '1484c669-8b2e-4efc-8eff-c4325e2a19ad', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '40270cb6-8b7f-4658-8ea8-17a800d63f2d', 'attached_at': '', 'detached_at': '', 'volume_id': '2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'serial': '2bead45a-38fa-42b7-bd54-8c1f88c67e01'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:19:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:32 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:32 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:32 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bdd932-cc3c-4ddc-b72e-9b21fd189277]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:19:32 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[44275f24-e19a-4d5f-82dc-3e64214827b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01] added
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7baa6-16db-45b9-9ca0-6fbabf340cb5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3922a53c-9d7e-4013-8171-2e82d28bd2fc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDQPsBlo {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDQPsBlo" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0881c14-dfc2-46c2-99d5-608b77c18839]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MDQPsBlo'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab1e52-3a17-470e-b92e-5d5c26009929]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: WARNING nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid d87483a2-cf0e-465c-b486-361aba4c613a {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid df974dc8-deda-4bdb-bb9d-1471bee040a7 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 70a306a5-f981-495f-9f3a-8fd5011b4ce1 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "25935a69-292b-4d55-932c-f4893838998c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3aee57-ee38-491a-b8cb-22a291767331]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "25935a69-292b-4d55-932c-f4893838998c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43fdad1-3c1c-43da-afbf-877f9ab1893c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]
Apr 11 17:19:32 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[34646b7a-6800-4968-bd12-0553af3fd779]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[214dba9a-d96d-48d9-9330-2679ed0dab20]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7537ecff-5ad8-458b-9504-8a473aab824e]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:19:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23164333164316134', 'path': '/dev/sdg'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164333164316134', 'path': '/dev/sdg'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:19:33 user nova-compute[71063]:   <uuid>40270cb6-8b7f-4658-8ea8-17a800d63f2d</uuid>
Apr 11 17:19:33 user nova-compute[71063]:   <name>instance-00000024</name>
Apr 11 17:19:33 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:19:33 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:19:33 user nova-compute[71063]:   <metadata>
Apr 11 17:19:33 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:19:33 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:19:33 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-95786467</nova:name>
Apr 11 17:19:33 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:19:32</nova:creationTime>
Apr 11 17:19:33 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:19:33 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:19:33 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:19:33 user nova-compute[71063]:       <nova:owner>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:19:33 user nova-compute[71063]:       </nova:owner>
Apr 11 17:19:33 user nova-compute[71063]:       <nova:ports>
Apr 11 17:19:33 user nova-compute[71063]:         <nova:port uuid="09360ccd-e24b-449a-9e15-b86a5a12b501">
Apr 11 17:19:33 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 17:19:33 user nova-compute[71063]:         </nova:port>
Apr 11 17:19:33 user nova-compute[71063]:       </nova:ports>
Apr 11 17:19:33 user nova-compute[71063]:     </nova:instance>
Apr 11 17:19:33 user nova-compute[71063]:   </metadata>
Apr 11 17:19:33 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:19:33 user nova-compute[71063]:     <system>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="serial">40270cb6-8b7f-4658-8ea8-17a800d63f2d</entry>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="uuid">40270cb6-8b7f-4658-8ea8-17a800d63f2d</entry>
Apr 11 17:19:33 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:19:33 user nova-compute[71063]:     </system>
Apr 11 17:19:33 user nova-compute[71063]:   </sysinfo>
Apr 11 17:19:33 user nova-compute[71063]:   <os>
Apr 11 17:19:33 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:19:33 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:19:33 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:19:33 user nova-compute[71063]:   </os>
Apr 11 17:19:33 user nova-compute[71063]:   <features>
Apr 11 17:19:33 user nova-compute[71063]:     <acpi/>
Apr 11 17:19:33 user nova-compute[71063]:     <apic/>
Apr 11 17:19:33 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:19:33 user nova-compute[71063]:   </features>
Apr 11 17:19:33 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:19:33 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:19:33 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:19:33 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:19:33 user nova-compute[71063]:   </clock>
Apr 11 17:19:33 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:19:33 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:19:33 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:19:33 user nova-compute[71063]:   </cpu>
Apr 11 17:19:33 user nova-compute[71063]:   <devices>
Apr 11 17:19:33 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:19:33 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:19:33 user nova-compute[71063]:       <source dev="/dev/sdg"/>
Apr 11 17:19:33 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:19:33 user nova-compute[71063]:       <serial>2bead45a-38fa-42b7-bd54-8c1f88c67e01</serial>
Apr 11 17:19:33 user nova-compute[71063]:     </disk>
Apr 11 17:19:33 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:19:33 user nova-compute[71063]:       <mac address="fa:16:3e:0f:63:dc"/>
Apr 11 17:19:33 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:33 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:19:33 user nova-compute[71063]:       <target dev="tap09360ccd-e2"/>
Apr 11 17:19:33 user nova-compute[71063]:     </interface>
Apr 11 17:19:33 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:19:33 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d/console.log" append="off"/>
Apr 11 17:19:33 user nova-compute[71063]:     </serial>
Apr 11 17:19:33 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:19:33 user nova-compute[71063]:     <video>
Apr 11 17:19:33 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:33 user nova-compute[71063]:     </video>
Apr 11 17:19:33 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:19:33 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:19:33 user nova-compute[71063]:     </rng>
Apr 11 17:19:33 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:19:33 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:19:33 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:19:33 user nova-compute[71063]:     </memballoon>
Apr 11 17:19:33 user nova-compute[71063]:   </devices>
Apr 11 17:19:33 user nova-compute[71063]: </domain>
Apr 11 17:19:33 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG os_vif [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09360ccd-e2, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09360ccd-e2, col_values=(('external_ids', {'iface-id': '09360ccd-e24b-449a-9e15-b86a5a12b501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:63:dc', 'vm-uuid': '40270cb6-8b7f-4658-8ea8-17a800d63f2d'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:33 user nova-compute[71063]: INFO os_vif [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2')
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:0f:63:dc, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:34 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a4def2-6225-49a3-8421-3ff431088fb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:19:34 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6361b2-5a4c-43c2-b97f-8f2f4db84210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6] added
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb545e-9972-49ee-b620-9c2217c9d1b6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007058f-8ad5-4bd8-aa8e-afb7d655d5aa]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuHBotQb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuHBotQb" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28115be-bfa6-4d55-9cb8-3779b2f3cfb5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JuHBotQb'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[25236765-0c45-48a8-8982-8084a24e39bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[776bcade-5a9a-473d-8203-fed450d39a78]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5512a80-9963-4cd3-9cdf-5af86d0fa9bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]
Apr 11 17:19:34 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ae24d-8276-49ab-9147-b41dc490ec81]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e461b8f-832d-4a80-b4b0-84eb8b10f06d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[39787f88-4775-4635-8a65-b0f0e5bd70c3]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:19:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26531633563666266', 'path': '/dev/sdh'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633563666266', 'path': '/dev/sdh'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:19:35 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:19:35 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:19:35 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:19:35 user nova-compute[71063]:   <serial>d97aa7e6-492f-4a89-9305-d2c10afa79a6</serial>
Apr 11 17:19:35 user nova-compute[71063]: </disk>
Apr 11 17:19:35 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:35 user nova-compute[71063]: WARNING nova.compute.manager [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state building and task_state spawning.
Apr 11 17:19:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:19:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No VIF found with MAC fa:16:3e:71:16:a5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:19:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.440s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.578s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:37 user nova-compute[71063]: WARNING nova.compute.manager [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state building and task_state spawning.
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233577.7720423, 40270cb6-8b7f-4658-8ea8-17a800d63f2d => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] VM Resumed (Lifecycle Event)
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance spawned successfully.
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233577.7740123, 40270cb6-8b7f-4658-8ea8-17a800d63f2d => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] VM Started (Lifecycle Event)
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 11 17:19:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:19:37 user nova-compute[71063]: INFO nova.compute.manager [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Took 11.46 seconds to build instance.
Apr 11 17:19:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.554s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.420s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:38 user nova-compute[71063]: INFO nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:19:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing instance network info cache due to event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updated VIF entry in instance network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing instance network info cache due to event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updated VIF entry in instance network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:43 user nova-compute[71063]: INFO nova.compute.manager [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Rebooting instance
Apr 11 17:19:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:19:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:44 user nova-compute[71063]: WARNING nova.compute.manager [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state active and task_state reboot_started_hard.
Apr 11 17:19:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance destroyed successfully.
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'resources' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:19:44Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef4e04c8-30, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:44 user nova-compute[71063]: INFO os_vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30')
Apr 11 17:19:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:44 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf816b05-6cc2-4a34-a505-cfcb8c24df84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:19:44 user nova-compute[71063]: No targets found.
Apr 11 17:19:44 user nova-compute[71063]: iSNS:
Apr 11 17:19:44 user nova-compute[71063]: No targets found.
Apr 11 17:19:44 user nova-compute[71063]: STATIC:
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:19:44 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:44 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:44 user nova-compute[71063]: FIRMWARE:
Apr 11 17:19:44 user nova-compute[71063]: No targets found.
Apr 11 17:19:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:19:44 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:19:44 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8540694-0b95-49bf-b24d-99ed177acb53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fd62ec-c2a0-4eed-afeb-0b4ad626b4d8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe807191b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6'): ({'sdh'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Removing single pathed devices sdh {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c90938-7587-4b37-b681-b24fcb3bcc73]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c978af0-2a16-4e5b-89f6-35bd5f1da655]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flushing IO for device /dev/sdh {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[65026463-7138-47bf-89a9-6a4c895d1c84]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.035s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d45fc-96f2-4121-94fb-654f0d52f349]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1919f1a9-bad5-4d54-8445-dcdb1ebf0436]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a12eb-ca91-486a-b3c1-bf446df2687a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]
Apr 11 17:19:45 user nova-compute[71063]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a326d7-dd75-4fdc-991e-ff287e80e6c0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== disconnect_volume: return (339ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start _get_guest_xml network_info=[{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f3215b4d-2cf9-4d8a-97ac-d18798f8f815,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'f3215b4d-2cf9-4d8a-97ac-d18798f8f815'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'attachment_id': 'aadd95c0-b9db-4c4e-a478-73c241865eda', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '9bf98306-a141-480b-97c0-6fdd7931b8f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd97aa7e6-492f-4a89-9305-d2c10afa79a6', 'serial': 'd97aa7e6-492f-4a89-9305-d2c10afa79a6'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:19:45 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:45 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f3215b4d-2cf9-4d8a-97ac-d18798f8f815,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.objects.instance [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:45 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:45 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:45 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c3003a-74f6-4c92-9572-488ede4f3e2e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:19:45 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[24369da1-6cc4-4c9f-a10e-197d43c5c51d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6] added
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3168ae-5957-419b-a5e6-3df3db0b0b89]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb25fb51-0360-4d52-a673-002906b522f6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuHBotQb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JuHBotQb" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab3dc2-fbdd-4472-8939-4a6ac88572bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JuHBotQb'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09ce16-0293-41f2-bdd7-9e1b6e5cdeb8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7331dbf7-f260-4ff1-92bb-89d49827baf5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b95b3-346c-4885-aa63-6d4cbee3274b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]
Apr 11 17:19:45 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5269eee3-4ea5-448c-9b06-5c9870f8f4aa]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9628414-1f60-4c90-8f56-e91c570b2ae0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:45 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HCTL ('39', '-', '-', 0) found on session 42 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb14f62b-c97c-421d-993f-919951407c64]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:19:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:46 user nova-compute[71063]: WARNING nova.compute.manager [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state active and task_state reboot_started_hard.
Apr 11 17:19:46 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26531633563666266', 'path': '/dev/sdh'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531633563666266', 'path': '/dev/sdh'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:19:44Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.objects.instance [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:19:46 user nova-compute[71063]:   <uuid>9bf98306-a141-480b-97c0-6fdd7931b8f6</uuid>
Apr 11 17:19:46 user nova-compute[71063]:   <name>instance-00000022</name>
Apr 11 17:19:46 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:19:46 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:19:46 user nova-compute[71063]:   <metadata>
Apr 11 17:19:46 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:19:46 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:name>tempest-TestMinimumBasicScenario-server-728641310</nova:name>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:19:45</nova:creationTime>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:19:46 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:19:46 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:owner>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:user uuid="eed61e2d73a84d85a9f5ff2b314624c9">tempest-TestMinimumBasicScenario-593818068-project-member</nova:user>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:project uuid="ab7ce3fc251f4f1eb9151d1ef8c86d91">tempest-TestMinimumBasicScenario-593818068</nova:project>
Apr 11 17:19:46 user nova-compute[71063]:       </nova:owner>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:root type="image" uuid="f3215b4d-2cf9-4d8a-97ac-d18798f8f815"/>
Apr 11 17:19:46 user nova-compute[71063]:       <nova:ports>
Apr 11 17:19:46 user nova-compute[71063]:         <nova:port uuid="ef4e04c8-3073-425e-a10b-ca224239fd2f">
Apr 11 17:19:46 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 17:19:46 user nova-compute[71063]:         </nova:port>
Apr 11 17:19:46 user nova-compute[71063]:       </nova:ports>
Apr 11 17:19:46 user nova-compute[71063]:     </nova:instance>
Apr 11 17:19:46 user nova-compute[71063]:   </metadata>
Apr 11 17:19:46 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:19:46 user nova-compute[71063]:     <system>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="serial">9bf98306-a141-480b-97c0-6fdd7931b8f6</entry>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="uuid">9bf98306-a141-480b-97c0-6fdd7931b8f6</entry>
Apr 11 17:19:46 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:19:46 user nova-compute[71063]:     </system>
Apr 11 17:19:46 user nova-compute[71063]:   </sysinfo>
Apr 11 17:19:46 user nova-compute[71063]:   <os>
Apr 11 17:19:46 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:19:46 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:19:46 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:19:46 user nova-compute[71063]:   </os>
Apr 11 17:19:46 user nova-compute[71063]:   <features>
Apr 11 17:19:46 user nova-compute[71063]:     <acpi/>
Apr 11 17:19:46 user nova-compute[71063]:     <apic/>
Apr 11 17:19:46 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:19:46 user nova-compute[71063]:   </features>
Apr 11 17:19:46 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:19:46 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:19:46 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:19:46 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:19:46 user nova-compute[71063]:   </clock>
Apr 11 17:19:46 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:19:46 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:19:46 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:19:46 user nova-compute[71063]:   </cpu>
Apr 11 17:19:46 user nova-compute[71063]:   <devices>
Apr 11 17:19:46 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:19:46 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:19:46 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk"/>
Apr 11 17:19:46 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:19:46 user nova-compute[71063]:     </disk>
Apr 11 17:19:46 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:19:46 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:19:46 user nova-compute[71063]:       <source dev="/dev/sdh"/>
Apr 11 17:19:46 user nova-compute[71063]:       <target dev="vdb" bus="virtio"/>
Apr 11 17:19:46 user nova-compute[71063]:       <serial>d97aa7e6-492f-4a89-9305-d2c10afa79a6</serial>
Apr 11 17:19:46 user nova-compute[71063]:     </disk>
Apr 11 17:19:46 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:19:46 user nova-compute[71063]:       <mac address="fa:16:3e:71:16:a5"/>
Apr 11 17:19:46 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:46 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:19:46 user nova-compute[71063]:       <target dev="tapef4e04c8-30"/>
Apr 11 17:19:46 user nova-compute[71063]:     </interface>
Apr 11 17:19:46 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:19:46 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/console.log" append="off"/>
Apr 11 17:19:46 user nova-compute[71063]:     </serial>
Apr 11 17:19:46 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:19:46 user nova-compute[71063]:     <video>
Apr 11 17:19:46 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:19:46 user nova-compute[71063]:     </video>
Apr 11 17:19:46 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:19:46 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:19:46 user nova-compute[71063]:     </rng>
Apr 11 17:19:46 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:19:46 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:19:46 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:19:46 user nova-compute[71063]:     </memballoon>
Apr 11 17:19:46 user nova-compute[71063]:   </devices>
Apr 11 17:19:46 user nova-compute[71063]: </domain>
Apr 11 17:19:46 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG nova.objects.instance [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:47 user nova-compute[71063]: INFO nova.compute.manager [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Terminating instance
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.compute.manager [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abc645818b6c6f91bed04fc23128ec655b4d3bd2 --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Cannot resize image /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'migration_context' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:19:44Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG os_vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef4e04c8-30, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef4e04c8-30, col_values=(('external_ids', {'iface-id': 'ef4e04c8-3073-425e-a10b-ca224239fd2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:16:a5', 'vm-uuid': '9bf98306-a141-480b-97c0-6fdd7931b8f6'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:47 user nova-compute[71063]: INFO os_vif [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30')
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-unplugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] No waiting events found dispatching network-vif-unplugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-unplugged-11a50593-74fe-4bfd-adc1-15e1537afc66 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:19:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Instance destroyed successfully.
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.objects.instance [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid df974dc8-deda-4bdb-bb9d-1471bee040a7 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:15:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1599483328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1599483328',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:15:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-0cbmthnk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:15:21Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=df974dc8-deda-4bdb-bb9d-1471bee040a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "11a50593-74fe-4bfd-adc1-15e1537afc66", "address": "fa:16:3e:94:57:89", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11a50593-74", "ovs_interfaceid": "11a50593-74fe-4bfd-adc1-15e1537afc66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_vif [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11a50593-74, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:48 user nova-compute[71063]: INFO os_vif [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:57:89,bridge_name='br-int',has_traffic_filtering=True,id=11a50593-74fe-4bfd-adc1-15e1537afc66,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11a50593-74')
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jGldaLXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:19:48 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe6905-d251-42b7-8326-6b8a37a17030]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:19:48 user nova-compute[71063]: No targets found.
Apr 11 17:19:48 user nova-compute[71063]: iSNS:
Apr 11 17:19:48 user nova-compute[71063]: No targets found.
Apr 11 17:19:48 user nova-compute[71063]: STATIC:
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:19:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:19:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:19:48 user nova-compute[71063]: FIRMWARE:
Apr 11 17:19:48 user nova-compute[71063]: No targets found.
Apr 11 17:19:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:19:48 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:19:48 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c800c4ee-82b5-40dc-860f-ee61c18af338]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2683db84-4f28-46f7-bace-bb46bf617692]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:19:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb411b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be233daf-4e52-49e4-99c5-17bf33716efc]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf3155-d644-452e-b522-76653cc5fe13]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b9bc7-ce2a-4d94-933c-b0ae07bca12c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d44ef-14a5-467f-bda7-dc69331d2f35]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64978ff-9dec-4ebe-b991-221063fd0f15]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[24818a58-e1f2-4db5-8c40-34a17b223137]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260]
Apr 11 17:19:48 user nova-compute[71063]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c, portal: 172.16.0.220,3260] successful.
Apr 11 17:19:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e99e75c-34b5-4135-a5c1-8037e24e601c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[47739771-4c93-491a-a29d-9a511b34410b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (338ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:19:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Deleting instance files /opt/stack/data/nova/instances/df974dc8-deda-4bdb-bb9d-1471bee040a7_del
Apr 11 17:19:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Deletion of /opt/stack/data/nova/instances/df974dc8-deda-4bdb-bb9d-1471bee040a7_del complete
Apr 11 17:19:48 user nova-compute[71063]: INFO nova.compute.manager [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Took 1.66 seconds to destroy the instance on the hypervisor.
Apr 11 17:19:48 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:19:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:49 user nova-compute[71063]: WARNING nova.compute.manager [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state active and task_state reboot_started_hard.
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:49 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Took 0.55 seconds to deallocate network for instance.
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-deleted-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Acquiring lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] No waiting events found dispatching network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:49 user nova-compute[71063]: WARNING nova.compute.manager [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Received unexpected event network-vif-plugged-11a50593-74fe-4bfd-adc1-15e1537afc66 for instance with vm_state active and task_state deleting.
Apr 11 17:19:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:50 user nova-compute[71063]: INFO nova.compute.manager [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Took 0.83 seconds to detach 1 volumes for instance.
Apr 11 17:19:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Deleting volume: 2e99e75c-34b5-4135-a5c1-8037e24e601c {{(pid=71063) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 17:19:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:50 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:50 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:50 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance df974dc8-deda-4bdb-bb9d-1471bee040a7
Apr 11 17:19:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "df974dc8-deda-4bdb-bb9d-1471bee040a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.757s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 9bf98306-a141-480b-97c0-6fdd7931b8f6 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233591.2394981, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] VM Resumed (Lifecycle Event)
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:51 user nova-compute[71063]: WARNING nova.compute.manager [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state active and task_state reboot_started_hard.
Apr 11 17:19:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance rebooted successfully.
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233591.2410278, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:19:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] VM Started (Lifecycle Event)
Apr 11 17:19:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.235s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:19:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:19:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:55 user nova-compute[71063]: INFO nova.compute.manager [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Terminating instance
Apr 11 17:19:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:55 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-unplugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:19:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Instance destroyed successfully.
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'resources' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1332777263',display_name='tempest-ServerRescueNegativeTestJSON-server-1332777263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1332777263',id=1,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16e55c9209ac4b11b5af5ec1ad14d8b5',ramdisk_id='',reservation_id='r-fu5ob7zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1553918933',owner_user_name='tempest-ServerRescueNegativeTestJSON-1553918933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:09:48Z,user_data=None,user_id='3666d19053684843b400aab6ebf29cce',uuid=25935a69-292b-4d55-932c-f4893838998c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converting VIF {"id": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "address": "fa:16:3e:d7:35:9d", "network": {"id": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1607326970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16e55c9209ac4b11b5af5ec1ad14d8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb26876bb-0e", "ovs_interfaceid": "b26876bb-0ee7-42f8-a592-b9078cd9701a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG os_vif [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb26876bb-0e, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:19:56 user nova-compute[71063]: INFO os_vif [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:35:9d,bridge_name='br-int',has_traffic_filtering=True,id=b26876bb-0ee7-42f8-a592-b9078cd9701a,network=Network(13083c72-58ed-4aa4-af8c-1e9f432f7f1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb26876bb-0e')
Apr 11 17:19:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Deleting instance files /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c_del
Apr 11 17:19:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Deletion of /opt/stack/data/nova/instances/25935a69-292b-4d55-932c-f4893838998c_del complete
Apr 11 17:19:56 user nova-compute[71063]: INFO nova.compute.manager [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 17:19:56 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:19:56 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] Took 0.46 seconds to deallocate network for instance.
Apr 11 17:19:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:57 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Deleted allocations for instance 25935a69-292b-4d55-932c-f4893838998c
Apr 11 17:19:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "25935a69-292b-4d55-932c-f4893838998c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Acquiring lock "25935a69-292b-4d55-932c-f4893838998c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Lock "25935a69-292b-4d55-932c-f4893838998c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:19:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] No waiting events found dispatching network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:19:57 user nova-compute[71063]: WARNING nova.compute.manager [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received unexpected event network-vif-plugged-b26876bb-0ee7-42f8-a592-b9078cd9701a for instance with vm_state deleted and task_state None.
Apr 11 17:19:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] [instance: 25935a69-292b-4d55-932c-f4893838998c] Received event network-vif-deleted-b26876bb-0ee7-42f8-a592-b9078cd9701a {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:19:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:03 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233588.2799823, df974dc8-deda-4bdb-bb9d-1471bee040a7 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:20:03 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] VM Stopped (Lifecycle Event)
Apr 11 17:20:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c47f842c-3a4e-4742-a6e3-3aa0302deb9d None None] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [{"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-1289fdf8-8842-4e16-80dc-a287bc08fb02" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:20:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:20:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:11 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233596.1296391, 25935a69-292b-4d55-932c-f4893838998c => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:20:11 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 25935a69-292b-4d55-932c-f4893838998c] VM Stopped (Lifecycle Event)
Apr 11 17:20:11 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e0bf3460-caef-4290-84b6-182e5b1b5014 None None] [instance: 25935a69-292b-4d55-932c-f4893838998c] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:13 user nova-compute[71063]: INFO nova.compute.manager [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Detaching volume 5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b
Apr 11 17:20:13 user nova-compute[71063]: INFO nova.virt.block_device [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Attempting to driver detach volume 5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b from mountpoint /dev/vdc
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Attempting to detach device vdc from instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:20:13 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:20:13 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:20:13 user nova-compute[71063]:   <target dev="vdc" bus="virtio"/>
Apr 11 17:20:13 user nova-compute[71063]:   <serial>5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b</serial>
Apr 11 17:20:13 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:20:13 user nova-compute[71063]: </disk>
Apr 11 17:20:13 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:20:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully detached device vdc from instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 from the persistent domain config.
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:20:13 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:20:13 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:20:13 user nova-compute[71063]:   <target dev="vdc" bus="virtio"/>
Apr 11 17:20:13 user nova-compute[71063]:   <serial>5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b</serial>
Apr 11 17:20:13 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:20:13 user nova-compute[71063]: </disk>
Apr 11 17:20:13 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233613.9361856, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:20:13 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully detached device vdc from instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 from the live domain config.
Apr 11 17:20:13 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SLmBnMCx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:20:13 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77452617-2140-4f90-a2f3-1a147a3324f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:20:13 user nova-compute[71063]: No targets found.
Apr 11 17:20:13 user nova-compute[71063]: iSNS:
Apr 11 17:20:13 user nova-compute[71063]: No targets found.
Apr 11 17:20:13 user nova-compute[71063]: STATIC:
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:20:13 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:13 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:13 user nova-compute[71063]: FIRMWARE:
Apr 11 17:20:13 user nova-compute[71063]: No targets found.
Apr 11 17:20:13 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:20:13 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:20:13 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7ce36-28ff-403e-9471-016b77aa8a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578344a-2573-44af-af84-a1aa86f56f69]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaaba27-3956-4491-9dfe-615afdd0f543]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca93812-9851-4ca7-bfbb-00bb32f4f17c]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c437ef-6b8b-4b36-acf4-87874fb49c24]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a7a3b-f14e-4c0f-afd7-e3cc0efe0fdf]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[410c7a20-8fa2-4999-8fdd-cb7dfd807529]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[376641ae-761f-42a7-8482-dfaafa9d0465]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260]
Apr 11 17:20:14 user nova-compute[71063]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b, portal: 172.16.0.220,3260] successful.
Apr 11 17:20:14 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff225849-602e-4e7f-8963-22d79e9e65a3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] <== disconnect_volume: return (348ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:20:14 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:20:15 user nova-compute[71063]: DEBUG nova.objects.instance [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'flavor' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:20:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:16 user nova-compute[71063]: INFO nova.compute.manager [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Terminating instance
Apr 11 17:20:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-unplugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Instance destroyed successfully.
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:14:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632176154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632176154',id=29,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-nxqs7k56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:18:31Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "7436f349-9b31-46f1-9866-ad1d71d06e06", "address": "fa:16:3e:96:7c:6c", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7436f349-9b", "ovs_interfaceid": "7436f349-9b31-46f1-9866-ad1d71d06e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_vif [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7436f349-9b, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:20:17 user nova-compute[71063]: INFO os_vif [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7c:6c,bridge_name='br-int',has_traffic_filtering=True,id=7436f349-9b31-46f1-9866-ad1d71d06e06,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7436f349-9b')
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PcFTufSB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:20:17 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[85577040-f557-49fc-b629-143d47a8c699]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:20:17 user nova-compute[71063]: No targets found.
Apr 11 17:20:17 user nova-compute[71063]: iSNS:
Apr 11 17:20:17 user nova-compute[71063]: No targets found.
Apr 11 17:20:17 user nova-compute[71063]: STATIC:
Apr 11 17:20:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:20:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:20:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:20:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:20:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08
Apr 11 17:20:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:20:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:20:17 user nova-compute[71063]: FIRMWARE:
Apr 11 17:20:17 user nova-compute[71063]: No targets found.
Apr 11 17:20:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:20:17 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:20:17 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3fd36-bad1-4c6d-8bd7-7f15fc3be9bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7006659-2523-4f9b-87c1-b3314457f56b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80135ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08'): ({'sde'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Removing single pathed devices sde {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8fe35-b839-472e-82a4-86f4a7608d33]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a253f-ff85-4c55-ad38-f463a0f28c1b]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flushing IO for device /dev/sde {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e8b40b-3266-42ee-ad2e-c393ad4083e9]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1fa87c-4662-4ecd-8cf3-73050712ce53]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1cc077d4-84012d908a90b66d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1cc077d4', '/dev/disk/by-id/scsi-23834303132643930') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f7c86-cabf-45ee-adb0-494e9bc4f331]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca1aaa8-92f4-4a46-a98c-fd7d241b112b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3b5443-af11-416a-b7fc-d94f5c8fe257]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260]
Apr 11 17:20:17 user nova-compute[71063]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08, portal: 172.16.0.220,3260] successful.
Apr 11 17:20:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685fee6-6f2e-47b1-9241-988ab7c7ec08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23132d-ab85-413a-abbd-7b37432d87f6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== disconnect_volume: return (324ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:20:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Deleting instance files /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8_del
Apr 11 17:20:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Deletion of /opt/stack/data/nova/instances/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8_del complete
Apr 11 17:20:17 user nova-compute[71063]: INFO nova.compute.manager [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 17:20:17 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:20:17 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:20:18 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:18 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Took 0.43 seconds to deallocate network for instance.
Apr 11 17:20:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-deleted-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:18 user nova-compute[71063]: INFO nova.compute.manager [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Neutron deleted interface 7436f349-9b31-46f1-9866-ad1d71d06e06; detaching it from the instance and deleting it from the info cache
Apr 11 17:20:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Detach interface failed, port_id=7436f349-9b31-46f1-9866-ad1d71d06e06, reason: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:19 user nova-compute[71063]: INFO nova.compute.manager [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Took 0.75 seconds to detach 1 volumes for instance.
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Acquiring lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] No waiting events found dispatching network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:20:19 user nova-compute[71063]: WARNING nova.compute.manager [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Received unexpected event network-vif-plugged-7436f349-9b31-46f1-9866-ad1d71d06e06 for instance with vm_state active and task_state deleting.
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.283s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:20:19 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Deleted allocations for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.839s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:20:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:20:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=26.14443588256836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance d87483a2-cf0e-465c-b486-361aba4c613a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:20:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:32 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233617.5237324, 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:20:32 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] VM Stopped (Lifecycle Event)
Apr 11 17:20:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c94a348e-6526-4738-b682-638ec69375c7 None None] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:20:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:41 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:20:41 user nova-compute[71063]: INFO nova.compute.claims [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Claim successful on node user
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:20:42 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:20:42 user nova-compute[71063]: INFO nova.virt.block_device [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Booting with volume 17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 at /dev/vda
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.policy [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.utils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7befaf4-7f9d-42be-b875-79512424a1e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a88dfe-d1d3-42ab-941d-423f7311763e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4176bc81-e430-4cc5-a09e-1e9732f3505b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63936d60-5a36-4443-80c6-2fefb6c3c183]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:20:42 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:20:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0dc646-8e79-44a6-b7c0-8b4360d7472a]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG os_brick.utils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:20:42 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updating existing volume attachment record: 4e0fe785-b3c3-465b-971e-4784ef8f019c {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:20:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Successfully created port: 8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:20:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Successfully updated port: 8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:20:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:20:43 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:20:43 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-changed-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Refreshing instance network info cache due to event network-changed-8f15c555-6010-4fdf-b40d-c262a826acd4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Acquiring lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updating instance_info_cache with network_info: [{"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Instance network_info: |[{"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Acquired lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Refreshing network info cache for port 8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updated VIF entry in instance network info cache for port 8f15c555-6010-4fdf-b40d-c262a826acd4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updating instance_info_cache with network_info: [{"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Releasing lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:20:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Creating image(s)
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Ensure instance console log exists: /opt/stack/data/nova/instances/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Start _get_guest_xml network_info=[{"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '4e0fe785-b3c3-465b-971e-4784ef8f019c', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e53bfed-5cf9-47c1-ae70-63b89a7f8d47', 'attached_at': '', 'detached_at': '', 'volume_id': '17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'serial': '17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:20:46 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:46 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:20:46 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:20:47 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:20:47 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:20:47 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb78546-a96b-4918-9bbd-60696118abbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:20:47 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc5f9b-420e-443e-b832-53171a166cfa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2] added
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c47d16-1ac7-41a9-9d4d-9f279cd0e3bf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d1475-005b-4002-97f1-fa23848a9aae]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKxwFSaq {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKxwFSaq" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[309058be-024b-4c94-a3c8-76af25187212]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKxwFSaq'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd801c-50e8-4832-93ed-aa5a4738366d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a5a30e-26cd-4efa-b2e2-aa225f7ff88e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f58751-2b81-403a-ad15-515c7b5b2246]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]
Apr 11 17:20:47 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb386d12-eafb-4220-a5ee-4719b88ec27e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[80239577-a78b-43ef-80d4-4bdff836cc57]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:20:47 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[135aa8b0-aae5-47f1-8d77-eb481071407c]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:20:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23161653865376136', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653865376136', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788190556',display_name='tempest-TestVolumeBootPattern-server-1788190556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788190556',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r1rmbpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:20:43Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=4e53bfed-5cf9-47c1-ae70-63b89a7f8d47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.objects.instance [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:20:48 user nova-compute[71063]:   <uuid>4e53bfed-5cf9-47c1-ae70-63b89a7f8d47</uuid>
Apr 11 17:20:48 user nova-compute[71063]:   <name>instance-00000025</name>
Apr 11 17:20:48 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:20:48 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:20:48 user nova-compute[71063]:   <metadata>
Apr 11 17:20:48 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:20:48 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:20:48 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-server-1788190556</nova:name>
Apr 11 17:20:48 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:20:46</nova:creationTime>
Apr 11 17:20:48 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:20:48 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:20:48 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:20:48 user nova-compute[71063]:       <nova:owner>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:20:48 user nova-compute[71063]:       </nova:owner>
Apr 11 17:20:48 user nova-compute[71063]:       <nova:ports>
Apr 11 17:20:48 user nova-compute[71063]:         <nova:port uuid="8f15c555-6010-4fdf-b40d-c262a826acd4">
Apr 11 17:20:48 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 17:20:48 user nova-compute[71063]:         </nova:port>
Apr 11 17:20:48 user nova-compute[71063]:       </nova:ports>
Apr 11 17:20:48 user nova-compute[71063]:     </nova:instance>
Apr 11 17:20:48 user nova-compute[71063]:   </metadata>
Apr 11 17:20:48 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:20:48 user nova-compute[71063]:     <system>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="serial">4e53bfed-5cf9-47c1-ae70-63b89a7f8d47</entry>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="uuid">4e53bfed-5cf9-47c1-ae70-63b89a7f8d47</entry>
Apr 11 17:20:48 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:20:48 user nova-compute[71063]:     </system>
Apr 11 17:20:48 user nova-compute[71063]:   </sysinfo>
Apr 11 17:20:48 user nova-compute[71063]:   <os>
Apr 11 17:20:48 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:20:48 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:20:48 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:20:48 user nova-compute[71063]:   </os>
Apr 11 17:20:48 user nova-compute[71063]:   <features>
Apr 11 17:20:48 user nova-compute[71063]:     <acpi/>
Apr 11 17:20:48 user nova-compute[71063]:     <apic/>
Apr 11 17:20:48 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:20:48 user nova-compute[71063]:   </features>
Apr 11 17:20:48 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:20:48 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:20:48 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:20:48 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:20:48 user nova-compute[71063]:   </clock>
Apr 11 17:20:48 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:20:48 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:20:48 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:20:48 user nova-compute[71063]:   </cpu>
Apr 11 17:20:48 user nova-compute[71063]:   <devices>
Apr 11 17:20:48 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:20:48 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:20:48 user nova-compute[71063]:       <source dev="/dev/sdc"/>
Apr 11 17:20:48 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:20:48 user nova-compute[71063]:       <serial>17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2</serial>
Apr 11 17:20:48 user nova-compute[71063]:     </disk>
Apr 11 17:20:48 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:20:48 user nova-compute[71063]:       <mac address="fa:16:3e:a9:38:66"/>
Apr 11 17:20:48 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:20:48 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:20:48 user nova-compute[71063]:       <target dev="tap8f15c555-60"/>
Apr 11 17:20:48 user nova-compute[71063]:     </interface>
Apr 11 17:20:48 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:20:48 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47/console.log" append="off"/>
Apr 11 17:20:48 user nova-compute[71063]:     </serial>
Apr 11 17:20:48 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:20:48 user nova-compute[71063]:     <video>
Apr 11 17:20:48 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:20:48 user nova-compute[71063]:     </video>
Apr 11 17:20:48 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:20:48 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:20:48 user nova-compute[71063]:     </rng>
Apr 11 17:20:48 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:20:48 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:20:48 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:20:48 user nova-compute[71063]:     </memballoon>
Apr 11 17:20:48 user nova-compute[71063]:   </devices>
Apr 11 17:20:48 user nova-compute[71063]: </domain>
Apr 11 17:20:48 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788190556',display_name='tempest-TestVolumeBootPattern-server-1788190556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788190556',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r1rmbpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:20:43Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=4e53bfed-5cf9-47c1-ae70-63b89a7f8d47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG os_vif [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f15c555-60, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f15c555-60, col_values=(('external_ids', {'iface-id': '8f15c555-6010-4fdf-b40d-c262a826acd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:38:66', 'vm-uuid': '4e53bfed-5cf9-47c1-ae70-63b89a7f8d47'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:48 user nova-compute[71063]: INFO os_vif [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60')
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:20:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:a9:38:66, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] No waiting events found dispatching network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:20:49 user nova-compute[71063]: WARNING nova.compute.manager [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received unexpected event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 for instance with vm_state building and task_state spawning.
Apr 11 17:20:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233651.877582, 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:20:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] VM Resumed (Lifecycle Event)
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:20:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Instance spawned successfully.
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:20:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233651.8791304, 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:20:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] VM Started (Lifecycle Event)
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:20:51 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:20:52 user nova-compute[71063]: INFO nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Took 5.06 seconds to spawn the instance on the hypervisor.
Apr 11 17:20:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:20:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] No waiting events found dispatching network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:20:52 user nova-compute[71063]: WARNING nova.compute.manager [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received unexpected event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 for instance with vm_state building and task_state spawning.
Apr 11 17:20:52 user nova-compute[71063]: INFO nova.compute.manager [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Took 10.19 seconds to build instance.
Apr 11 17:20:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.289s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:55 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:20:55 user nova-compute[71063]: INFO nova.compute.claims [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Claim successful on node user
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:20:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.policy [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:20:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Creating image(s)
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "/opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "/opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "/opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk 1073741824" returned: 0 in 0.053s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:56 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Successfully created port: 255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Cannot resize image /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'migration_context' on Instance uuid 7426fa28-ae58-444f-b2f4-32b079cbaede {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Ensure instance console log exists: /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Successfully updated port: 255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquired lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-changed-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.compute.manager [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Refreshing instance network info cache due to event network-changed-255d0d03-b986-4328-917b-e54a4e1228be. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Acquiring lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:20:57 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Updating instance_info_cache with network_info: [{"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Releasing lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Instance network_info: |[{"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Acquired lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.neutron [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Refreshing network info cache for port 255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Start _get_guest_xml network_info=[{"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:20:58 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:58 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-778355250',display_name='tempest-VolumesActionsTest-instance-778355250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-778355250',id=38,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-rlc08a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:20:56Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=7426fa28-ae58-444f-b2f4-32b079cbaede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'pci_devices' on Instance uuid 7426fa28-ae58-444f-b2f4-32b079cbaede {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:20:58 user nova-compute[71063]:   <uuid>7426fa28-ae58-444f-b2f4-32b079cbaede</uuid>
Apr 11 17:20:58 user nova-compute[71063]:   <name>instance-00000026</name>
Apr 11 17:20:58 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:20:58 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:20:58 user nova-compute[71063]:   <metadata>
Apr 11 17:20:58 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:20:58 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:name>tempest-VolumesActionsTest-instance-778355250</nova:name>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:20:58</nova:creationTime>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:20:58 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:20:58 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:owner>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:user uuid="aeef943ec0a0456da8e9b742385ac7f6">tempest-VolumesActionsTest-815942062-project-member</nova:user>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:project uuid="fd4d0572552242c69df31613597ed588">tempest-VolumesActionsTest-815942062</nova:project>
Apr 11 17:20:58 user nova-compute[71063]:       </nova:owner>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:20:58 user nova-compute[71063]:       <nova:ports>
Apr 11 17:20:58 user nova-compute[71063]:         <nova:port uuid="255d0d03-b986-4328-917b-e54a4e1228be">
Apr 11 17:20:58 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 17:20:58 user nova-compute[71063]:         </nova:port>
Apr 11 17:20:58 user nova-compute[71063]:       </nova:ports>
Apr 11 17:20:58 user nova-compute[71063]:     </nova:instance>
Apr 11 17:20:58 user nova-compute[71063]:   </metadata>
Apr 11 17:20:58 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:20:58 user nova-compute[71063]:     <system>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="serial">7426fa28-ae58-444f-b2f4-32b079cbaede</entry>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="uuid">7426fa28-ae58-444f-b2f4-32b079cbaede</entry>
Apr 11 17:20:58 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:20:58 user nova-compute[71063]:     </system>
Apr 11 17:20:58 user nova-compute[71063]:   </sysinfo>
Apr 11 17:20:58 user nova-compute[71063]:   <os>
Apr 11 17:20:58 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:20:58 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:20:58 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:20:58 user nova-compute[71063]:   </os>
Apr 11 17:20:58 user nova-compute[71063]:   <features>
Apr 11 17:20:58 user nova-compute[71063]:     <acpi/>
Apr 11 17:20:58 user nova-compute[71063]:     <apic/>
Apr 11 17:20:58 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:20:58 user nova-compute[71063]:   </features>
Apr 11 17:20:58 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:20:58 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:20:58 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:20:58 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:20:58 user nova-compute[71063]:   </clock>
Apr 11 17:20:58 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:20:58 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:20:58 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:20:58 user nova-compute[71063]:   </cpu>
Apr 11 17:20:58 user nova-compute[71063]:   <devices>
Apr 11 17:20:58 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:20:58 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:20:58 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk"/>
Apr 11 17:20:58 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:20:58 user nova-compute[71063]:     </disk>
Apr 11 17:20:58 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:20:58 user nova-compute[71063]:       <mac address="fa:16:3e:1b:76:02"/>
Apr 11 17:20:58 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:20:58 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:20:58 user nova-compute[71063]:       <target dev="tap255d0d03-b9"/>
Apr 11 17:20:58 user nova-compute[71063]:     </interface>
Apr 11 17:20:58 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:20:58 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/console.log" append="off"/>
Apr 11 17:20:58 user nova-compute[71063]:     </serial>
Apr 11 17:20:58 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:20:58 user nova-compute[71063]:     <video>
Apr 11 17:20:58 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:20:58 user nova-compute[71063]:     </video>
Apr 11 17:20:58 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:20:58 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:20:58 user nova-compute[71063]:     </rng>
Apr 11 17:20:58 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:20:58 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:20:58 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:20:58 user nova-compute[71063]:     </memballoon>
Apr 11 17:20:58 user nova-compute[71063]:   </devices>
Apr 11 17:20:58 user nova-compute[71063]: </domain>
Apr 11 17:20:58 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-778355250',display_name='tempest-VolumesActionsTest-instance-778355250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-778355250',id=38,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-rlc08a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:20:56Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=7426fa28-ae58-444f-b2f4-32b079cbaede,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG os_vif [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap255d0d03-b9, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap255d0d03-b9, col_values=(('external_ids', {'iface-id': '255d0d03-b986-4328-917b-e54a4e1228be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:76:02', 'vm-uuid': '7426fa28-ae58-444f-b2f4-32b079cbaede'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:58 user nova-compute[71063]: INFO os_vif [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9')
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] No VIF found with MAC fa:16:3e:1b:76:02, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.neutron [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Updated VIF entry in instance network info cache for port 255d0d03-b986-4328-917b-e54a4e1228be. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG nova.network.neutron [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Updating instance_info_cache with network_info: [{"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:20:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Releasing lock "refresh_cache-7426fa28-ae58-444f-b2f4-32b079cbaede" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:20:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] No waiting events found dispatching network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:20:59 user nova-compute[71063]: WARNING nova.compute.manager [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received unexpected event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be for instance with vm_state building and task_state spawning.
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233661.6270187, 7426fa28-ae58-444f-b2f4-32b079cbaede => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] VM Resumed (Lifecycle Event)
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Instance spawned successfully.
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233661.6292593, 7426fa28-ae58-444f-b2f4-32b079cbaede => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] VM Started (Lifecycle Event)
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Took 5.25 seconds to spawn the instance on the hypervisor.
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:01 user nova-compute[71063]: INFO nova.compute.manager [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Took 6.07 seconds to build instance.
Apr 11 17:21:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.157s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:01 user nova-compute[71063]: DEBUG nova.compute.manager [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] No waiting events found dispatching network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:01 user nova-compute[71063]: WARNING nova.compute.manager [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received unexpected event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be for instance with vm_state active and task_state None.
Apr 11 17:21:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:03 user nova-compute[71063]: INFO nova.compute.manager [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Terminating instance
Apr 11 17:21:03 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-unplugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:21:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Instance destroyed successfully.
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'resources' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2104871241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2104871241',id=28,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFqFHOn8aPRX0q5MSRPMTTacpD4HYx1m4dQ1XGm7PdPNjP6f9xXOv0GIXZGtAqKHrXu3xeE1uYxfyAMROxwbD8IK2W1cFmzOptY72oYUTM7AtAciDDzgNoF5MkpmQhYKg==',key_name='tempest-keypair-385713192',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:18:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-c4y8gr9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=49e044ae-91af-4db8-b0fe-3679dd210ab2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "address": "fa:16:3e:35:10:e5", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7d89bc-13", "ovs_interfaceid": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG os_vif [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d7d89bc-13, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:21:04 user nova-compute[71063]: INFO os_vif [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:10:e5,bridge_name='br-int',has_traffic_filtering=True,id=4d7d89bc-13fc-41ae-b35c-618cc375d3b4,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7d89bc-13')
Apr 11 17:21:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Deleting instance files /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2_del
Apr 11 17:21:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Deletion of /opt/stack/data/nova/instances/49e044ae-91af-4db8-b0fe-3679dd210ab2_del complete
Apr 11 17:21:04 user nova-compute[71063]: INFO nova.compute.manager [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 17:21:04 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:21:04 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:21:05 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:05 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Took 0.70 seconds to deallocate network for instance.
Apr 11 17:21:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:05 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:05 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:05 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Deleted allocations for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2
Apr 11 17:21:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Acquiring lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:06 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Lock "49e044ae-91af-4db8-b0fe-3679dd210ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] No waiting events found dispatching network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:06 user nova-compute[71063]: WARNING nova.compute.manager [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received unexpected event network-vif-plugged-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance with vm_state deleted and task_state None.
Apr 11 17:21:06 user nova-compute[71063]: DEBUG nova.compute.manager [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Received event network-vif-deleted-4d7d89bc-13fc-41ae-b35c-618cc375d3b4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:07 user nova-compute[71063]: INFO nova.compute.manager [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Terminating instance
Apr 11 17:21:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-unplugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] No waiting events found dispatching network-vif-unplugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-unplugged-3e2ec196-65df-4e44-adfd-613978e38721 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:21:08 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Instance destroyed successfully.
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid d87483a2-cf0e-465c-b486-361aba4c613a {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-934361943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-934361943',id=25,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-mr1gmr5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:13:43Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=d87483a2-cf0e-465c-b486-361aba4c613a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "3e2ec196-65df-4e44-adfd-613978e38721", "address": "fa:16:3e:ff:28:a3", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2ec196-65", "ovs_interfaceid": "3e2ec196-65df-4e44-adfd-613978e38721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG os_vif [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e2ec196-65, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:21:08 user nova-compute[71063]: INFO os_vif [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:28:a3,bridge_name='br-int',has_traffic_filtering=True,id=3e2ec196-65df-4e44-adfd-613978e38721,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2ec196-65')
Apr 11 17:21:08 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Deleting instance files /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a_del
Apr 11 17:21:08 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Deletion of /opt/stack/data/nova/instances/d87483a2-cf0e-465c-b486-361aba4c613a_del complete
Apr 11 17:21:08 user nova-compute[71063]: INFO nova.compute.manager [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:21:08 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:08 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Took 0.46 seconds to deallocate network for instance.
Apr 11 17:21:08 user nova-compute[71063]: DEBUG nova.compute.manager [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-deleted-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:09 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Deleted allocations for instance d87483a2-cf0e-465c-b486-361aba4c613a
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "d87483a2-cf0e-465c-b486-361aba4c613a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.824s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Acquiring lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Lock "d87483a2-cf0e-465c-b486-361aba4c613a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:09 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] No waiting events found dispatching network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:09 user nova-compute[71063]: WARNING nova.compute.manager [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Received unexpected event network-vif-plugged-3e2ec196-65df-4e44-adfd-613978e38721 for instance with vm_state deleted and task_state None.
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:10 user nova-compute[71063]: INFO nova.compute.manager [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Terminating instance
Apr 11 17:21:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-changed-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Refreshing instance network info cache due to event network-changed-714e84f4-64ee-4448-9681-881a322ec1a8. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Acquiring lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Acquired lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Refreshing network info cache for port 714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Instance destroyed successfully.
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'resources' on Instance uuid 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-859055886',display_name='tempest-AttachVolumeNegativeTest-server-859055886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-859055886',id=35,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCuqLGitNmsyVl6DZ1ST80abe9aOW0E48/T6TICTipu2zcFtu5oS+mkIEMmnW66SQRO+/LAO1Q8Zo0FD1QUJVbuMdMPql+IgEKelMKNrv1CNM86lLuJwhRYOR7Ri5AxeA==',key_name='tempest-keypair-1047793130',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-nu17zxgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG os_vif [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap714e84f4-64, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:21:11 user nova-compute[71063]: INFO os_vif [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6d:3a,bridge_name='br-int',has_traffic_filtering=True,id=714e84f4-64ee-4448-9681-881a322ec1a8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap714e84f4-64')
Apr 11 17:21:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Deleting instance files /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc_del
Apr 11 17:21:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Deletion of /opt/stack/data/nova/instances/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc_del complete
Apr 11 17:21:11 user nova-compute[71063]: INFO nova.compute.manager [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 17:21:11 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updated VIF entry in instance network info cache for port 714e84f4-64ee-4448-9681-881a322ec1a8. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG nova.network.neutron [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updating instance_info_cache with network_info: [{"id": "714e84f4-64ee-4448-9681-881a322ec1a8", "address": "fa:16:3e:bc:6d:3a", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap714e84f4-64", "ovs_interfaceid": "714e84f4-64ee-4448-9681-881a322ec1a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Releasing lock "refresh_cache-0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Took 1.26 seconds to deallocate network for instance.
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-vif-deleted-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-vif-unplugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] No waiting events found dispatching network-vif-unplugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:12 user nova-compute[71063]: WARNING nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received unexpected event network-vif-unplugged-714e84f4-64ee-4448-9681-881a322ec1a8 for instance with vm_state deleted and task_state None.
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Acquiring lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] No waiting events found dispatching network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:12 user nova-compute[71063]: WARNING nova.compute.manager [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Received unexpected event network-vif-plugged-714e84f4-64ee-4448-9681-881a322ec1a8 for instance with vm_state deleted and task_state None.
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:13 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Deleted allocations for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc
Apr 11 17:21:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.492s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:21:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing instance network info cache due to event network-changed-2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Refreshing network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updated VIF entry in instance network info cache for port 2a3246a9-9ae1-4f3e-9e23-37c3702e9879. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Stashing vm_state: active {{(pid=71063) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_requests' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:21:18 user nova-compute[71063]: INFO nova.compute.claims [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Claim successful on node user
Apr 11 17:21:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'pci_devices' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:18 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating resource usage from migration 3c87c7d9-a3d5-457a-9974-25385168679a
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.401s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:19 user nova-compute[71063]: INFO nova.compute.manager [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Migrating
Apr 11 17:21:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-changed-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Refreshing instance network info cache due to event network-changed-09360ccd-e24b-449a-9e15-b86a5a12b501. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233664.5324988, 49e044ae-91af-4db8-b0fe-3679dd210ab2 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:19 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] VM Stopped (Lifecycle Event)
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-57c863aa-26ae-4fdd-bcc2-6add498bb62b None None] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Refreshing network info cache for port 09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Starting migrate_disk_and_power_off {{(pid=71063) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updated VIF entry in instance network info cache for port 09360ccd-e24b-449a-9e15-b86a5a12b501. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.network.neutron [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:20 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance destroyed successfully.
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09360ccd-e2, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: INFO os_vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2')
Apr 11 17:21:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:21:20 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761daa2-5f19-4cd8-bfe1-6147d0a69ec2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:21:20 user nova-compute[71063]: No targets found.
Apr 11 17:21:20 user nova-compute[71063]: iSNS:
Apr 11 17:21:20 user nova-compute[71063]: No targets found.
Apr 11 17:21:20 user nova-compute[71063]: STATIC:
Apr 11 17:21:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:21:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:21:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:21:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:21:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:20 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:21:20 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:20 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:20 user nova-compute[71063]: FIRMWARE:
Apr 11 17:21:20 user nova-compute[71063]: No targets found.
Apr 11 17:21:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:21:20 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:21:20 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89498a64-d5fb-4ee1-a49b-c90bf8b44526]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c571cb-b252-4d71-8720-2133994b9676]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80718b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01'): ({'sdg'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sdg {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[56886a5c-209f-43f0-b47a-7fad9d9301c6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9a88e4-5f14-4c6a-96c2-a388d2ae8ec6]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sdg {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe510c06-7e9b-43c7-8bb4-967143a98e89]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d96da4-d726-4f6e-83d6-fb1683d1b13e]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sdg have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d7c315f', '/dev/disk/by-id/scsi-1SCST_BIO5d7c315f-1d31d1a49c98a4c7', '/dev/disk/by-id/scsi-23164333164316134') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:21:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[18620bbe-8e5f-43af-a549-974857c10b07]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dec1817-adde-484f-9e9d-b8a41b5f7683]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd3cb1d-a824-4a9f-9474-42ca85ac1c6a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]
Apr 11 17:21:21 user nova-compute[71063]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.
Apr 11 17:21:21 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb32f4b-28ef-43dc-a942-7e06e4d44dd7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (341ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:21 user nova-compute[71063]: WARNING nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state active and task_state resize_migrating.
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:21 user nova-compute[71063]: WARNING nova.compute.manager [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state active and task_state resize_migrating.
Apr 11 17:21:21 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:21:21 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:21:21 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=26.23720932006836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Applying migration context for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d as it has an incoming, in-progress migration 3c87c7d9-a3d5-457a-9974-25385168679a. Migration status is migrating {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 17:21:22 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating resource usage from migration 3c87c7d9-a3d5-457a-9974-25385168679a
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7426fa28-ae58-444f-b2f4-32b079cbaede actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Migration 3c87c7d9-a3d5-457a-9974-25385168679a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Port 09360ccd-e24b-449a-9e15-b86a5a12b501 binding to destination host user is already ACTIVE {{(pid=71063) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:22 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233668.1849346, d87483a2-cf0e-465c-b486-361aba4c613a => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:23 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] VM Stopped (Lifecycle Event)
Apr 11 17:21:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-d670c861-d804-41dd-9e27-beeac980c794 None None] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2fdbe-4c53-44a1-ab2d-f21f2249e70a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a828c1-5639-4da9-9d68-9773691fd434]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[360b24ce-4e3b-4f05-8884-61292d6f1342]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc7122-bb5d-4a66-83e6-3f43ea3a573b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:21:23 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:21:23 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f189a799-e623-4c79-84c2-2f7a658991b9]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:21:23 user nova-compute[71063]: DEBUG os_brick.utils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:21:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233671.2808232, 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] VM Stopped (Lifecycle Event)
Apr 11 17:21:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-50bf7198-8cf7-4fe1-a497-c647a89cc236 None None] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Starting finish_migration {{(pid=71063) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance directory exists: not creating {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 17:21:27 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Creating image(s)
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Ensure instance console log exists: /opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start _get_guest_xml network_info=[{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '26b9db34-2414-4f24-ad23-270d91d0c9c7', 'delete_on_termination': True, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '40270cb6-8b7f-4658-8ea8-17a800d63f2d', 'attached_at': '2023-04-11T17:21:28.000000', 'detached_at': '', 'volume_id': '2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'serial': '2bead45a-38fa-42b7-bd54-8c1f88c67e01'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:21:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:21:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:21:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:21:27 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:21:27 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[070b7697-3d83-4a12-afc0-9b68d28b842a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:21:27 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0006b26-5ffc-4f44-bd00-6cfc49f9c42f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01] added
Apr 11 17:21:27 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fb8aab-ba6b-4f33-9de4-a8fb52f9d544]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce872f86-908d-470a-badb-2db52163b8ff]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDQPsBlo {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDQPsBlo" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f0b9c-9e95-41bb-a343-e31ad966588c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MDQPsBlo'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9001b3ac-d6a3-4427-bd74-63e1b14473ea]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2786fb-5b6e-4e8c-ab46-6e1e8bfd960f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[abedaf6b-5d79-4417-a711-f8c15af99031]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]
Apr 11 17:21:28 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.
Apr 11 17:21:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1276aa4-015d-4c92-9db9-0bf98a2b0355]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e23a46-463f-42d3-b5da-0e65d3327e8e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:28 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797b3a5-946a-4bea-a61f-170f165c6ac5]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:28 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23164333164316134', 'path': '/dev/sde'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164333164316134', 'path': '/dev/sde'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:21:29 user nova-compute[71063]:   <uuid>40270cb6-8b7f-4658-8ea8-17a800d63f2d</uuid>
Apr 11 17:21:29 user nova-compute[71063]:   <name>instance-00000024</name>
Apr 11 17:21:29 user nova-compute[71063]:   <memory>196608</memory>
Apr 11 17:21:29 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:21:29 user nova-compute[71063]:   <metadata>
Apr 11 17:21:29 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:21:29 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:21:29 user nova-compute[71063]:       <nova:name>tempest-ServerActionsTestJSON-server-95786467</nova:name>
Apr 11 17:21:29 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:21:27</nova:creationTime>
Apr 11 17:21:29 user nova-compute[71063]:       <nova:flavor name="m1.micro">
Apr 11 17:21:29 user nova-compute[71063]:         <nova:memory>192</nova:memory>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:21:29 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:21:29 user nova-compute[71063]:       <nova:owner>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:user uuid="8f4ba7d7f3f74b5c800be2408c1035e2">tempest-ServerActionsTestJSON-499420188-project-member</nova:user>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:project uuid="db242f5f39d94966948e8b487cd52d0c">tempest-ServerActionsTestJSON-499420188</nova:project>
Apr 11 17:21:29 user nova-compute[71063]:       </nova:owner>
Apr 11 17:21:29 user nova-compute[71063]:       <nova:ports>
Apr 11 17:21:29 user nova-compute[71063]:         <nova:port uuid="09360ccd-e24b-449a-9e15-b86a5a12b501">
Apr 11 17:21:29 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 17:21:29 user nova-compute[71063]:         </nova:port>
Apr 11 17:21:29 user nova-compute[71063]:       </nova:ports>
Apr 11 17:21:29 user nova-compute[71063]:     </nova:instance>
Apr 11 17:21:29 user nova-compute[71063]:   </metadata>
Apr 11 17:21:29 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:21:29 user nova-compute[71063]:     <system>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="serial">40270cb6-8b7f-4658-8ea8-17a800d63f2d</entry>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="uuid">40270cb6-8b7f-4658-8ea8-17a800d63f2d</entry>
Apr 11 17:21:29 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:21:29 user nova-compute[71063]:     </system>
Apr 11 17:21:29 user nova-compute[71063]:   </sysinfo>
Apr 11 17:21:29 user nova-compute[71063]:   <os>
Apr 11 17:21:29 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:21:29 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:21:29 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:21:29 user nova-compute[71063]:   </os>
Apr 11 17:21:29 user nova-compute[71063]:   <features>
Apr 11 17:21:29 user nova-compute[71063]:     <acpi/>
Apr 11 17:21:29 user nova-compute[71063]:     <apic/>
Apr 11 17:21:29 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:21:29 user nova-compute[71063]:   </features>
Apr 11 17:21:29 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:21:29 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:21:29 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:21:29 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:21:29 user nova-compute[71063]:   </clock>
Apr 11 17:21:29 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:21:29 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:21:29 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:21:29 user nova-compute[71063]:   </cpu>
Apr 11 17:21:29 user nova-compute[71063]:   <devices>
Apr 11 17:21:29 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:21:29 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:21:29 user nova-compute[71063]:       <source dev="/dev/sde"/>
Apr 11 17:21:29 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:21:29 user nova-compute[71063]:       <serial>2bead45a-38fa-42b7-bd54-8c1f88c67e01</serial>
Apr 11 17:21:29 user nova-compute[71063]:     </disk>
Apr 11 17:21:29 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:21:29 user nova-compute[71063]:       <mac address="fa:16:3e:0f:63:dc"/>
Apr 11 17:21:29 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:21:29 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:21:29 user nova-compute[71063]:       <target dev="tap09360ccd-e2"/>
Apr 11 17:21:29 user nova-compute[71063]:     </interface>
Apr 11 17:21:29 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:21:29 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d/console.log" append="off"/>
Apr 11 17:21:29 user nova-compute[71063]:     </serial>
Apr 11 17:21:29 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:21:29 user nova-compute[71063]:     <video>
Apr 11 17:21:29 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:21:29 user nova-compute[71063]:     </video>
Apr 11 17:21:29 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:21:29 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:21:29 user nova-compute[71063]:     </rng>
Apr 11 17:21:29 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:21:29 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:21:29 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:21:29 user nova-compute[71063]:     </memballoon>
Apr 11 17:21:29 user nova-compute[71063]:   </devices>
Apr 11 17:21:29 user nova-compute[71063]: </domain>
Apr 11 17:21:29 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1609098204-network", "vif_mac": "fa:16:3e:0f:63:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG os_vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09360ccd-e2, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09360ccd-e2, col_values=(('external_ids', {'iface-id': '09360ccd-e24b-449a-9e15-b86a5a12b501', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:63:dc', 'vm-uuid': '40270cb6-8b7f-4658-8ea8-17a800d63f2d'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:29 user nova-compute[71063]: INFO os_vif [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2')
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] No VIF found with MAC fa:16:3e:0f:63:dc, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:21:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:30 user nova-compute[71063]: WARNING nova.compute.manager [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state active and task_state resize_finish.
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 40270cb6-8b7f-4658-8ea8-17a800d63f2d due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233692.6408358, 40270cb6-8b7f-4658-8ea8-17a800d63f2d => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] VM Resumed (Lifecycle Event)
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:21:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance running successfully.
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Failed to set time: agent not configured {{(pid=71063) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] finish_migration finished successfully. {{(pid=71063) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:21:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233692.6441598, 40270cb6-8b7f-4658-8ea8-17a800d63f2d => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:21:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] VM Started (Lifecycle Event)
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:21:32 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:32 user nova-compute[71063]: WARNING nova.compute.manager [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state resized and task_state None.
Apr 11 17:21:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing instance network info cache due to event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:34 user nova-compute[71063]: DEBUG nova.network.neutron [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updated VIF entry in instance network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing instance network info cache due to event network-changed-ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Acquiring lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Acquired lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Refreshing network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:36 user nova-compute[71063]: INFO nova.compute.manager [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Detaching volume d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:21:36 user nova-compute[71063]: INFO nova.virt.block_device [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Attempting to driver detach volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 from mountpoint /dev/vdb
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Attempting to detach device vdb from instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:21:36 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:21:36 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:21:36 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:21:36 user nova-compute[71063]:   <serial>d97aa7e6-492f-4a89-9305-d2c10afa79a6</serial>
Apr 11 17:21:36 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:21:36 user nova-compute[71063]: </disk>
Apr 11 17:21:36 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:21:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully detached device vdb from instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 from the persistent domain config.
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:21:36 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:21:36 user nova-compute[71063]:   <source dev="/dev/sdh"/>
Apr 11 17:21:36 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:21:36 user nova-compute[71063]:   <serial>d97aa7e6-492f-4a89-9305-d2c10afa79a6</serial>
Apr 11 17:21:36 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 17:21:36 user nova-compute[71063]: </disk>
Apr 11 17:21:36 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updated VIF entry in instance network info cache for port ef4e04c8-3073-425e-a10b-ca224239fd2f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [{"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Releasing lock "refresh_cache-9bf98306-a141-480b-97c0-6fdd7931b8f6" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233696.7055051, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:21:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully detached device vdb from instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 from the live domain config.
Apr 11 17:21:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JuHBotQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:21:36 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f0c3a0-babc-4eab-a8bd-c9629c32406d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:21:36 user nova-compute[71063]: No targets found.
Apr 11 17:21:36 user nova-compute[71063]: iSNS:
Apr 11 17:21:36 user nova-compute[71063]: No targets found.
Apr 11 17:21:36 user nova-compute[71063]: STATIC:
Apr 11 17:21:36 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:21:36 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:36 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:36 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:21:36 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:36 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:36 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:21:36 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:36 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:36 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:21:36 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:36 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:36 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6
Apr 11 17:21:36 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:36 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:36 user nova-compute[71063]: FIRMWARE:
Apr 11 17:21:36 user nova-compute[71063]: No targets found.
Apr 11 17:21:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:21:36 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:21:36 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0d96a-0ba3-498e-a143-3255ea8a9d9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a76c1c-9c12-4647-be28-6cc81f03715e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6'): ({'sdh'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Removing single pathed devices sdh {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3bb4fa-b2bf-4e8f-ab02-175ddea09a4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b10ff4-b191-42c0-b6a1-337560e7fea5]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flushing IO for device /dev/sdh {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7753c-55a8-4892-b1ab-f99a129eead7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243b7bb-9db8-42be-a091-cb66d4e56e04]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] SCSI volumes sdh have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e59f193-d2a2-4ce5-84fd-ff2f862c78c4]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c61ebe-21b9-49be-a202-c985968a4d37]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260]
Apr 11 17:21:37 user nova-compute[71063]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6, portal: 172.16.0.220,3260] successful.
Apr 11 17:21:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97aa7e6-492f-4a89-9305-d2c10afa79a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc8a770-1f6d-46b1-992f-2448c32685e2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== disconnect_volume: return (347ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:21:57 user nova-compute[71063]: INFO nova.compute.claims [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Claim successful on node user
Apr 11 17:21:57 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:57 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:58 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:21:58 user nova-compute[71063]: INFO nova.compute.manager [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Terminating instance
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:21:58 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Creating image(s)
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.policy [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.compute.manager [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-unplugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.171s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk 1073741824" returned: 0 in 0.054s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Instance destroyed successfully.
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:06:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1291128519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1291128519',id=14,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:08:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-7w7db0fg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:10:00Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=1289fdf8-8842-4e16-80dc-a287bc08fb02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "address": "fa:16:3e:d4:9b:bc", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d00c4b-a9", "ovs_interfaceid": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_vif [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d00c4b-a9, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Cannot resize image /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'migration_context' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:21:58 user nova-compute[71063]: INFO os_vif [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=67d00c4b-a9a1-4ac1-8df9-e7fd43a17056,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d00c4b-a9')
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIPDxtjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:21:58 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Ensure instance console log exists: /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c5d516-7a84-4983-9578-00fcc80f20d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:21:58 user nova-compute[71063]: No targets found.
Apr 11 17:21:58 user nova-compute[71063]: iSNS:
Apr 11 17:21:58 user nova-compute[71063]: No targets found.
Apr 11 17:21:58 user nova-compute[71063]: STATIC:
Apr 11 17:21:58 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70
Apr 11 17:21:58 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:58 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:58 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:21:58 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:58 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:58 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:21:58 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:58 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:58 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:21:58 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:21:58 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:21:58 user nova-compute[71063]: FIRMWARE:
Apr 11 17:21:58 user nova-compute[71063]: No targets found.
Apr 11 17:21:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:21:58 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:21:58 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a5873-a014-4f00-ac29-529c36dba329]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8e6dd-ae40-49a4-9d9a-2f16182d304c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:21:58 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e38553-f4fd-4673-80dc-989e66095c8a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Successfully created port: 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0fbbf-7c0b-4399-b8ca-654edfcf5ee2]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:21:58 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72f236-d648-45af-9e42-fb92795e9010]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34eef7-8926-4d83-be52-5d059933913a]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f3d422-bd26-4b6f-8b6a-e2b08a0e1fd2]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4cd722-2c7a-4c67-9bb4-9002bf6a1fe4]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260]
Apr 11 17:21:59 user nova-compute[71063]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70, portal: 172.16.0.220,3260] successful.
Apr 11 17:21:59 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c91d72cc-4a7c-493c-992e-ac58f20b3c70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077f0ac-0e7e-493b-8bbb-e6be3c8b27a0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] <== disconnect_volume: return (344ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:21:59 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Deleting instance files /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02_del
Apr 11 17:21:59 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Deletion of /opt/stack/data/nova/instances/1289fdf8-8842-4e16-80dc-a287bc08fb02_del complete
Apr 11 17:21:59 user nova-compute[71063]: INFO nova.compute.manager [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Successfully updated port: 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:21:59 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Took 0.44 seconds to deallocate network for instance.
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.compute.manager [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing instance network info cache due to event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:21:59 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Acquiring lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] No waiting events found dispatching network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:00 user nova-compute[71063]: WARNING nova.compute.manager [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received unexpected event network-vif-plugged-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance with vm_state active and task_state deleting.
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Received event network-vif-deleted-67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance network_info: |[{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.neutron [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start _get_guest_xml network_info=[{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:22:00 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:22:00 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER06UAVi3Q++YC5IiYnLZmfsdNe0rK6icCcgHlC03GX/fdzJHXoeYyuwz1vL6kQvN/1agaN7Felkq60IsaoEVHWhTREOURBecopzDJIXKfwl1FISMDpgIfn5xEca/pyRw==',key_name='tempest-keypair-1845823024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_devices' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:00 user nova-compute[71063]: INFO nova.compute.manager [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:22:00 user nova-compute[71063]:   <uuid>e5c59a1a-121c-41c4-8ca4-b6675b5191c8</uuid>
Apr 11 17:22:00 user nova-compute[71063]:   <name>instance-00000027</name>
Apr 11 17:22:00 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:22:00 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:22:00 user nova-compute[71063]:   <metadata>
Apr 11 17:22:00 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:22:00 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1970963305</nova:name>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:22:00</nova:creationTime>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:22:00 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:22:00 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:owner>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:user uuid="b69069a1461d485598e2078cc12772a5">tempest-AttachVolumeShelveTestJSON-2051096798-project-member</nova:user>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:project uuid="fce268052b8046e5a7efa41048e96645">tempest-AttachVolumeShelveTestJSON-2051096798</nova:project>
Apr 11 17:22:00 user nova-compute[71063]:       </nova:owner>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:22:00 user nova-compute[71063]:       <nova:ports>
Apr 11 17:22:00 user nova-compute[71063]:         <nova:port uuid="9f57f039-208c-41c2-93cd-7df0ca44218f">
Apr 11 17:22:00 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 17:22:00 user nova-compute[71063]:         </nova:port>
Apr 11 17:22:00 user nova-compute[71063]:       </nova:ports>
Apr 11 17:22:00 user nova-compute[71063]:     </nova:instance>
Apr 11 17:22:00 user nova-compute[71063]:   </metadata>
Apr 11 17:22:00 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:22:00 user nova-compute[71063]:     <system>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="serial">e5c59a1a-121c-41c4-8ca4-b6675b5191c8</entry>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="uuid">e5c59a1a-121c-41c4-8ca4-b6675b5191c8</entry>
Apr 11 17:22:00 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:22:00 user nova-compute[71063]:     </system>
Apr 11 17:22:00 user nova-compute[71063]:   </sysinfo>
Apr 11 17:22:00 user nova-compute[71063]:   <os>
Apr 11 17:22:00 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:22:00 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:22:00 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:22:00 user nova-compute[71063]:   </os>
Apr 11 17:22:00 user nova-compute[71063]:   <features>
Apr 11 17:22:00 user nova-compute[71063]:     <acpi/>
Apr 11 17:22:00 user nova-compute[71063]:     <apic/>
Apr 11 17:22:00 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:22:00 user nova-compute[71063]:   </features>
Apr 11 17:22:00 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:22:00 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:22:00 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:22:00 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:22:00 user nova-compute[71063]:   </clock>
Apr 11 17:22:00 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:22:00 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:22:00 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:22:00 user nova-compute[71063]:   </cpu>
Apr 11 17:22:00 user nova-compute[71063]:   <devices>
Apr 11 17:22:00 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:22:00 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:22:00 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk"/>
Apr 11 17:22:00 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:22:00 user nova-compute[71063]:     </disk>
Apr 11 17:22:00 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:22:00 user nova-compute[71063]:       <mac address="fa:16:3e:e2:d7:89"/>
Apr 11 17:22:00 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:22:00 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:22:00 user nova-compute[71063]:       <target dev="tap9f57f039-20"/>
Apr 11 17:22:00 user nova-compute[71063]:     </interface>
Apr 11 17:22:00 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:22:00 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/console.log" append="off"/>
Apr 11 17:22:00 user nova-compute[71063]:     </serial>
Apr 11 17:22:00 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:22:00 user nova-compute[71063]:     <video>
Apr 11 17:22:00 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:22:00 user nova-compute[71063]:     </video>
Apr 11 17:22:00 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:22:00 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:22:00 user nova-compute[71063]:     </rng>
Apr 11 17:22:00 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:22:00 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:22:00 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:22:00 user nova-compute[71063]:     </memballoon>
Apr 11 17:22:00 user nova-compute[71063]:   </devices>
Apr 11 17:22:00 user nova-compute[71063]: </domain>
Apr 11 17:22:00 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER06UAVi3Q++YC5IiYnLZmfsdNe0rK6icCcgHlC03GX/fdzJHXoeYyuwz1vL6kQvN/1agaN7Felkq60IsaoEVHWhTREOURBecopzDJIXKfwl1FISMDpgIfn5xEca/pyRw==',key_name='tempest-keypair-1845823024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:21:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG os_vif [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f57f039-20, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f57f039-20, col_values=(('external_ids', {'iface-id': '9f57f039-208c-41c2-93cd-7df0ca44218f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:d7:89', 'vm-uuid': 'e5c59a1a-121c-41c4-8ca4-b6675b5191c8'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:00 user nova-compute[71063]: INFO os_vif [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20')
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No VIF found with MAC fa:16:3e:e2:d7:89, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.neutron [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updated VIF entry in instance network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG nova.network.neutron [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:22:00 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Deleted allocations for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02
Apr 11 17:22:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "1289fdf8-8842-4e16-80dc-a287bc08fb02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:01 user nova-compute[71063]: INFO nova.compute.manager [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Detaching volume 6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:22:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:02 user nova-compute[71063]: INFO nova.virt.block_device [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Attempting to driver detach volume 6b9154d8-9977-4c02-89a1-26975750e0a5 from mountpoint /dev/vdb
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Attempting to detach device vdb from instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:22:02 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:22:02 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:22:02 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:22:02 user nova-compute[71063]:   <serial>6b9154d8-9977-4c02-89a1-26975750e0a5</serial>
Apr 11 17:22:02 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:22:02 user nova-compute[71063]: </disk>
Apr 11 17:22:02 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:22:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb from the persistent domain config.
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:22:02 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:22:02 user nova-compute[71063]:   <source dev="/dev/sdd"/>
Apr 11 17:22:02 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:22:02 user nova-compute[71063]:   <serial>6b9154d8-9977-4c02-89a1-26975750e0a5</serial>
Apr 11 17:22:02 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:22:02 user nova-compute[71063]: </disk>
Apr 11 17:22:02 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:02 user nova-compute[71063]: WARNING nova.compute.manager [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state building and task_state spawning.
Apr 11 17:22:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233722.6300323, b5f9fe94-98f0-4094-8003-53c06cbfd5cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:22:02 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb from the live domain config.
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBPFJrnu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:22:02 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56ff948-537e-45d4-a50b-78da70f8e59e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:22:02 user nova-compute[71063]: No targets found.
Apr 11 17:22:02 user nova-compute[71063]: iSNS:
Apr 11 17:22:02 user nova-compute[71063]: No targets found.
Apr 11 17:22:02 user nova-compute[71063]: STATIC:
Apr 11 17:22:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:22:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:22:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:22:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:22:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:22:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:22:02 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5
Apr 11 17:22:02 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:22:02 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:22:02 user nova-compute[71063]: FIRMWARE:
Apr 11 17:22:02 user nova-compute[71063]: No targets found.
Apr 11 17:22:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:22:02 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:22:02 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[088bb167-78f9-448b-90f7-37762915f0ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd07adc-7dfa-4df3-964e-feb0a2bc047d]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:22:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80645e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b8408a-bea1-47c6-a87a-1c6cb4188c48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd9277e-faeb-45dc-8321-57c0a86ea188]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e24d3-1eed-4096-85c6-26ff789d20bb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba65943-911e-4afa-9c06-95e186f5be19]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdcee3d-e735-4a3a-a4aa-05610b6d7038]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6c6a0-7f76-40d5-b507-1904c5a62469]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260]
Apr 11 17:22:02 user nova-compute[71063]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5, portal: 172.16.0.220,3260] successful.
Apr 11 17:22:02 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b9154d8-9977-4c02-89a1-26975750e0a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c407c083-9404-4baf-b875-d63c8df511ce]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== disconnect_volume: return (287ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:22:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:22:03 user nova-compute[71063]: DEBUG nova.objects.instance [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.795s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:04 user nova-compute[71063]: WARNING nova.compute.manager [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state building and task_state spawning.
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233724.4002554, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Resumed (Lifecycle Event)
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance spawned successfully.
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233724.4013395, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Started (Lifecycle Event)
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 11 17:22:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:04 user nova-compute[71063]: INFO nova.compute.manager [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Took 7.05 seconds to build instance.
Apr 11 17:22:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.139s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [{"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-05988541-51cb-4e52-912e-ddf2b773db6b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:22:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:22:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:09 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:11 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:13 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233718.791326, 1289fdf8-8842-4e16-80dc-a287bc08fb02 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:22:13 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] VM Stopped (Lifecycle Event)
Apr 11 17:22:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8b364fb3-f033-45fe-9330-7d4437c6da2c None None] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:22:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:21 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:22:22 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=26.20616912841797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Applying migration context for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d as it has an incoming, in-progress migration 3c87c7d9-a3d5-457a-9974-25385168679a. Migration status is finished {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 17:22:22 user nova-compute[71063]: INFO nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating resource usage from migration 3c87c7d9-a3d5-457a-9974-25385168679a
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 05988541-51cb-4e52-912e-ddf2b773db6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7426fa28-ae58-444f-b2f4-32b079cbaede actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Migration 3c87c7d9-a3d5-457a-9974-25385168679a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:22:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:22:23 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:23 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:22:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:27 user nova-compute[71063]: INFO nova.compute.manager [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Terminating instance
Apr 11 17:22:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:27 user nova-compute[71063]: DEBUG nova.compute.manager [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-unplugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:22:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Instance destroyed successfully.
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.objects.instance [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'resources' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-728641310',display_name='tempest-TestMinimumBasicScenario-server-728641310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-728641310',id=34,image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg==',key_name='tempest-TestMinimumBasicScenario-1224626118',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-zicr0wow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:19:51Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=9bf98306-a141-480b-97c0-6fdd7931b8f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "address": "fa:16:3e:71:16:a5", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4e04c8-30", "ovs_interfaceid": "ef4e04c8-3073-425e-a10b-ca224239fd2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG os_vif [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef4e04c8-30, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:22:28 user nova-compute[71063]: INFO os_vif [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:16:a5,bridge_name='br-int',has_traffic_filtering=True,id=ef4e04c8-3073-425e-a10b-ca224239fd2f,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4e04c8-30')
Apr 11 17:22:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Deleting instance files /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6_del
Apr 11 17:22:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Deletion of /opt/stack/data/nova/instances/9bf98306-a141-480b-97c0-6fdd7931b8f6_del complete
Apr 11 17:22:28 user nova-compute[71063]: INFO nova.compute.manager [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 17:22:28 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:22:28 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:29 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Took 0.65 seconds to deallocate network for instance.
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-deleted-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:29 user nova-compute[71063]: INFO nova.compute.manager [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Neutron deleted interface ef4e04c8-3073-425e-a10b-ca224239fd2f; detaching it from the instance and deleting it from the info cache
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.compute.manager [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Detach interface failed, port_id=ef4e04c8-3073-425e-a10b-ca224239fd2f, reason: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:29 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Deleted allocations for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6
Apr 11 17:22:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Acquiring lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Lock "9bf98306-a141-480b-97c0-6fdd7931b8f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] No waiting events found dispatching network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:30 user nova-compute[71063]: WARNING nova.compute.manager [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Received unexpected event network-vif-plugged-ef4e04c8-3073-425e-a10b-ca224239fd2f for instance with vm_state deleted and task_state None.
Apr 11 17:22:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-changed-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Refreshing instance network info cache due to event network-changed-8f15c555-6010-4fdf-b40d-c262a826acd4. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:22:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Acquiring lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:22:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Acquired lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:22:33 user nova-compute[71063]: DEBUG nova.network.neutron [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Refreshing network info cache for port 8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG nova.network.neutron [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updated VIF entry in instance network info cache for port 8f15c555-6010-4fdf-b40d-c262a826acd4. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG nova.network.neutron [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updating instance_info_cache with network_info: [{"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Releasing lock "refresh_cache-4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:35 user nova-compute[71063]: INFO nova.compute.manager [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Terminating instance
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-unplugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] No waiting events found dispatching network-vif-unplugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-unplugged-8f15c555-6010-4fdf-b40d-c262a826acd4 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:22:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Instance destroyed successfully.
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788190556',display_name='tempest-TestVolumeBootPattern-server-1788190556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788190556',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:20:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-r1rmbpmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:20:52Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=4e53bfed-5cf9-47c1-ae70-63b89a7f8d47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "8f15c555-6010-4fdf-b40d-c262a826acd4", "address": "fa:16:3e:a9:38:66", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f15c555-60", "ovs_interfaceid": "8f15c555-6010-4fdf-b40d-c262a826acd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_vif [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f15c555-60, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:22:35 user nova-compute[71063]: INFO os_vif [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:38:66,bridge_name='br-int',has_traffic_filtering=True,id=8f15c555-6010-4fdf-b40d-c262a826acd4,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f15c555-60')
Apr 11 17:22:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:22:35 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa2e3e-46c2-4c17-aabc-97a21ec20471]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:22:35 user nova-compute[71063]: No targets found.
Apr 11 17:22:35 user nova-compute[71063]: iSNS:
Apr 11 17:22:35 user nova-compute[71063]: No targets found.
Apr 11 17:22:35 user nova-compute[71063]: STATIC:
Apr 11 17:22:35 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:22:35 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:22:35 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:22:35 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:22:35 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:22:35 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:22:35 user nova-compute[71063]: FIRMWARE:
Apr 11 17:22:35 user nova-compute[71063]: No targets found.
Apr 11 17:22:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:22:35 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:22:35 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f5bb0-6d0f-48fa-b876-6057120ac6b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae71cc4-83c1-4d72-a809-adccf62db846]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:22:35 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:22:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:22:35 user nova-compute[71063]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:22:35 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8063a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7669f7-769f-4739-86f6-ad2f9b370fee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9e0c76-6717-432c-b338-322ad54087c3]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3daed97-23d5-4d4a-904a-d501bf50091f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d02952-ba92-4ee4-a574-4b6f96faa791]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO80e4dff2-1ae8e7a67ac8a78f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_80e4dff2', '/dev/disk/by-id/scsi-23161653865376136') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b7bea-cf89-4856-bf08-7737aa5acc06]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c8dcd-c415-4ff0-9eb0-df07b6ace63a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:35 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d592d42-6f3a-4e61-aeb4-1f8445d7391d]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]
Apr 11 17:22:36 user nova-compute[71063]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.
Apr 11 17:22:36 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a3dc28-d53c-4a66-bce3-4848035b2157]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (296ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:22:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Deleting instance files /opt/stack/data/nova/instances/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47_del
Apr 11 17:22:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Deletion of /opt/stack/data/nova/instances/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47_del complete
Apr 11 17:22:36 user nova-compute[71063]: INFO nova.compute.manager [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 11 17:22:36 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:22:36 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:36 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Took 0.74 seconds to deallocate network for instance.
Apr 11 17:22:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Acquiring lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] No waiting events found dispatching network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:37 user nova-compute[71063]: WARNING nova.compute.manager [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received unexpected event network-vif-plugged-8f15c555-6010-4fdf-b40d-c262a826acd4 for instance with vm_state active and task_state deleting.
Apr 11 17:22:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Received event network-vif-deleted-8f15c555-6010-4fdf-b40d-c262a826acd4 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:37 user nova-compute[71063]: INFO nova.compute.manager [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:38 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47
Apr 11 17:22:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.103s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:43 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233748.407378, 9bf98306-a141-480b-97c0-6fdd7931b8f6 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:22:43 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] VM Stopped (Lifecycle Event)
Apr 11 17:22:43 user nova-compute[71063]: DEBUG nova.compute.manager [None req-12617297-18d5-49f8-832a-709c0b4bfcee None None] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:46 user nova-compute[71063]: INFO nova.compute.manager [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Terminating instance
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-unplugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] No waiting events found dispatching network-vif-unplugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.compute.manager [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-unplugged-255d0d03-b986-4328-917b-e54a4e1228be for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:22:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Instance destroyed successfully.
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.objects.instance [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'resources' on Instance uuid 7426fa28-ae58-444f-b2f4-32b079cbaede {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-778355250',display_name='tempest-VolumesActionsTest-instance-778355250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-778355250',id=38,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-rlc08a0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:21:02Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=7426fa28-ae58-444f-b2f4-32b079cbaede,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "255d0d03-b986-4328-917b-e54a4e1228be", "address": "fa:16:3e:1b:76:02", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap255d0d03-b9", "ovs_interfaceid": "255d0d03-b986-4328-917b-e54a4e1228be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG os_vif [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap255d0d03-b9, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:46 user nova-compute[71063]: INFO os_vif [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:76:02,bridge_name='br-int',has_traffic_filtering=True,id=255d0d03-b986-4328-917b-e54a4e1228be,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap255d0d03-b9')
Apr 11 17:22:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Deleting instance files /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede_del
Apr 11 17:22:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Deletion of /opt/stack/data/nova/instances/7426fa28-ae58-444f-b2f4-32b079cbaede_del complete
Apr 11 17:22:46 user nova-compute[71063]: INFO nova.compute.manager [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 17:22:46 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:22:46 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:47 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Took 0.52 seconds to deallocate network for instance.
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-deleted-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:47 user nova-compute[71063]: INFO nova.compute.manager [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Neutron deleted interface 255d0d03-b986-4328-917b-e54a4e1228be; detaching it from the instance and deleting it from the info cache
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.network.neutron [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.compute.manager [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Detach interface failed, port_id=255d0d03-b986-4328-917b-e54a4e1228be, reason: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:47 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Deleted allocations for instance 7426fa28-ae58-444f-b2f4-32b079cbaede
Apr 11 17:22:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.605s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Acquiring lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Lock "7426fa28-ae58-444f-b2f4-32b079cbaede-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] No waiting events found dispatching network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:48 user nova-compute[71063]: WARNING nova.compute.manager [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Received unexpected event network-vif-plugged-255d0d03-b986-4328-917b-e54a4e1228be for instance with vm_state deleted and task_state None.
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:48 user nova-compute[71063]: INFO nova.compute.manager [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Terminating instance
Apr 11 17:22:48 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:48 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:49 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Instance destroyed successfully.
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'resources' on Instance uuid 05988541-51cb-4e52-912e-ddf2b773db6b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:03:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1883237379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1883237379',id=6,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:03:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='361d59e2f9ac4a68a1a738cc3f2a9d14',ramdisk_id='',reservation_id='r-79wkmbbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:05:10Z,user_data=None,user_id='79b5fefb1e9748b8bf51535099bf5327',uuid=05988541-51cb-4e52-912e-ddf2b773db6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converting VIF {"id": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "address": "fa:16:3e:15:a8:b1", "network": {"id": "f3262209-0a5c-4763-99ae-a8319122d98c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1220240581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "361d59e2f9ac4a68a1a738cc3f2a9d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4ebd413-52", "ovs_interfaceid": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG os_vif [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4ebd413-52, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:22:49 user nova-compute[71063]: INFO os_vif [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:a8:b1,bridge_name='br-int',has_traffic_filtering=True,id=f4ebd413-5243-4c27-8dc3-91a5991d3ecf,network=Network(f3262209-0a5c-4763-99ae-a8319122d98c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4ebd413-52')
Apr 11 17:22:49 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Deleting instance files /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b_del
Apr 11 17:22:49 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Deletion of /opt/stack/data/nova/instances/05988541-51cb-4e52-912e-ddf2b773db6b_del complete
Apr 11 17:22:49 user nova-compute[71063]: INFO nova.compute.manager [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-unplugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] No waiting events found dispatching network-vif-unplugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-unplugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Acquiring lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "05988541-51cb-4e52-912e-ddf2b773db6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] No waiting events found dispatching network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:49 user nova-compute[71063]: WARNING nova.compute.manager [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received unexpected event network-vif-plugged-f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance with vm_state active and task_state deleting.
Apr 11 17:22:49 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:49 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Took 0.46 seconds to deallocate network for instance.
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:50 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:50 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:50 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Deleted allocations for instance 05988541-51cb-4e52-912e-ddf2b773db6b
Apr 11 17:22:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "05988541-51cb-4e52-912e-ddf2b773db6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.536s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:50 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233755.7419782, 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:22:50 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] VM Stopped (Lifecycle Event)
Apr 11 17:22:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-208d72a7-0698-40cc-a5cf-63d9218ffc3d None None] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:22:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Received event network-vif-deleted-f4ebd413-5243-4c27-8dc3-91a5991d3ecf {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:52 user nova-compute[71063]: INFO nova.compute.manager [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Terminating instance
Apr 11 17:22:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Instance destroyed successfully.
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'resources' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466344126',display_name='tempest-AttachVolumeNegativeTest-server-466344126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466344126',id=32,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIiVZRIcFyrvGPDYWVH2yITtiQzaRj2SywIZW4J28+dHZ1qwOIi5RhBpem8WI1Pb6Gr2152T3472CaYxEgZeL4HFHRz9zhJhhcmnLlUaTw8qfm4gEhwuOe1dDzwWwz76g==',key_name='tempest-keypair-1874843256',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-jbbbs19g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:17:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=b5f9fe94-98f0-4094-8003-53c06cbfd5cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "address": "fa:16:3e:df:02:d7", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ec17eb0-1b", "ovs_interfaceid": "4ec17eb0-1b20-4679-9900-3fa2850b50b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG os_vif [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ec17eb0-1b, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: INFO os_vif [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:02:d7,bridge_name='br-int',has_traffic_filtering=True,id=4ec17eb0-1b20-4679-9900-3fa2850b50b8,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ec17eb0-1b')
Apr 11 17:22:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Deleting instance files /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb_del
Apr 11 17:22:53 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Deletion of /opt/stack/data/nova/instances/b5f9fe94-98f0-4094-8003-53c06cbfd5cb_del complete
Apr 11 17:22:53 user nova-compute[71063]: INFO nova.compute.manager [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:22:53 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:53 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:54 user nova-compute[71063]: WARNING nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state active and task_state deleting.
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:54 user nova-compute[71063]: WARNING nova.compute.manager [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state active and task_state deleting.
Apr 11 17:22:54 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:22:54 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Took 1.68 seconds to deallocate network for instance.
Apr 11 17:22:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:55 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:22:55 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:22:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:55 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Deleted allocations for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb
Apr 11 17:22:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.987s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:56 user nova-compute[71063]: WARNING nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state deleted and task_state None.
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:56 user nova-compute[71063]: WARNING nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-unplugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state deleted and task_state None.
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Acquiring lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "b5f9fe94-98f0-4094-8003-53c06cbfd5cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] No waiting events found dispatching network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:22:56 user nova-compute[71063]: WARNING nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received unexpected event network-vif-plugged-4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance with vm_state deleted and task_state None.
Apr 11 17:22:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Received event network-vif-deleted-4ec17eb0-1b20-4679-9900-3fa2850b50b8 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:22:58 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:01 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233766.88944, 7426fa28-ae58-444f-b2f4-32b079cbaede => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:01 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] VM Stopped (Lifecycle Event)
Apr 11 17:23:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a0d644d0-ecbe-4840-a72b-5194547b1caa None None] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:23:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:04 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233769.2661724, 05988541-51cb-4e52-912e-ddf2b773db6b => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:04 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] VM Stopped (Lifecycle Event)
Apr 11 17:23:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-525be4fe-05ae-41f8-b5c3-eb08e63cffbb None None] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233773.1580825, b5f9fe94-98f0-4094-8003-53c06cbfd5cb => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:08 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] VM Stopped (Lifecycle Event)
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ac8ff84b-39cd-4a9e-9e41-ae50aa702433 None None] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Going to confirm migration 2 {{(pid=71063) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'info_cache' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'migration_context' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:09 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:09 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.215s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:09 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Deleted allocation for migration 3c87c7d9-a3d5-457a-9974-25385168679a
Apr 11 17:23:09 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.154s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:13 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:23:18 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:23:21 user nova-compute[71063]: INFO nova.compute.claims [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Claim successful on node user
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:23:21 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:23:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG nova.policy [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:23:22 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Creating image(s)
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "/opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "/opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "2614bed95473649c9b7c2727a8897f91f93e461f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "2614bed95473649c9b7c2727a8897f91f93e461f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:22 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.part --force-share --output=json" returned: 0 in 0.160s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.virt.images [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 137b317a-9b41-43a6-8479-f72f88cdf361 was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.part /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Successfully created port: 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.part /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.converted" returned: 0 in 0.514s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "2614bed95473649c9b7c2727a8897f91f93e461f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.611s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "2614bed95473649c9b7c2727a8897f91f93e461f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "2614bed95473649c9b7c2727a8897f91f93e461f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Successfully updated port: 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing instance network info cache due to event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json" returned: 0 in 0.511s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f,backing_fmt=raw /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f,backing_fmt=raw /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk 1073741824" returned: 0 in 0.056s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "2614bed95473649c9b7c2727a8897f91f93e461f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.571s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:24 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:24 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=26.338455200195312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2614bed95473649c9b7c2727a8897f91f93e461f --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Cannot resize image /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'migration_context' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Ensure instance console log exists: /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance network_info: |[{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Start _get_guest_xml network_info=[{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:23:19Z,direct_url=<?>,disk_format='qcow2',id=137b317a-9b41-43a6-8479-f72f88cdf361,min_disk=0,min_ram=0,name='tempest-scenario-img--2104270856',owner='ab7ce3fc251f4f1eb9151d1ef8c86d91',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:23:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': '137b317a-9b41-43a6-8479-f72f88cdf361'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:23:24 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:24 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T17:23:19Z,direct_url=<?>,disk_format='qcow2',id=137b317a-9b41-43a6-8479-f72f88cdf361,min_disk=0,min_ram=0,name='tempest-scenario-img--2104270856',owner='ab7ce3fc251f4f1eb9151d1ef8c86d91',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T17:23:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1524069267',display_name='tempest-TestMinimumBasicScenario-server-1524069267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1524069267',id=40,image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiu9qs/8o9kvPO8W0Ojte7aOyHvHP1DL9rJi5LT5sMYD56u8SdO3IgkaWMqrP4DE0Bx/YMDMssf23hFHZssiVzqDM3Ta2uifIuvMqB1k9eG/UXvBn0IVBogGXgha1c2JQ==',key_name='tempest-TestMinimumBasicScenario-1538973025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-7t4iqf09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:22Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=7b2cc7a5-a96b-426e-852c-39b011fe2a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:23:24 user nova-compute[71063]:   <uuid>7b2cc7a5-a96b-426e-852c-39b011fe2a53</uuid>
Apr 11 17:23:24 user nova-compute[71063]:   <name>instance-00000028</name>
Apr 11 17:23:24 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:23:24 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:23:24 user nova-compute[71063]:   <metadata>
Apr 11 17:23:24 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:23:24 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:name>tempest-TestMinimumBasicScenario-server-1524069267</nova:name>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:23:24</nova:creationTime>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:23:24 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:23:24 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:owner>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:user uuid="eed61e2d73a84d85a9f5ff2b314624c9">tempest-TestMinimumBasicScenario-593818068-project-member</nova:user>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:project uuid="ab7ce3fc251f4f1eb9151d1ef8c86d91">tempest-TestMinimumBasicScenario-593818068</nova:project>
Apr 11 17:23:24 user nova-compute[71063]:       </nova:owner>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:root type="image" uuid="137b317a-9b41-43a6-8479-f72f88cdf361"/>
Apr 11 17:23:24 user nova-compute[71063]:       <nova:ports>
Apr 11 17:23:24 user nova-compute[71063]:         <nova:port uuid="9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638">
Apr 11 17:23:24 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 17:23:24 user nova-compute[71063]:         </nova:port>
Apr 11 17:23:24 user nova-compute[71063]:       </nova:ports>
Apr 11 17:23:24 user nova-compute[71063]:     </nova:instance>
Apr 11 17:23:24 user nova-compute[71063]:   </metadata>
Apr 11 17:23:24 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:23:24 user nova-compute[71063]:     <system>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="serial">7b2cc7a5-a96b-426e-852c-39b011fe2a53</entry>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="uuid">7b2cc7a5-a96b-426e-852c-39b011fe2a53</entry>
Apr 11 17:23:24 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:23:24 user nova-compute[71063]:     </system>
Apr 11 17:23:24 user nova-compute[71063]:   </sysinfo>
Apr 11 17:23:24 user nova-compute[71063]:   <os>
Apr 11 17:23:24 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:23:24 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:23:24 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:23:24 user nova-compute[71063]:   </os>
Apr 11 17:23:24 user nova-compute[71063]:   <features>
Apr 11 17:23:24 user nova-compute[71063]:     <acpi/>
Apr 11 17:23:24 user nova-compute[71063]:     <apic/>
Apr 11 17:23:24 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:23:24 user nova-compute[71063]:   </features>
Apr 11 17:23:24 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:23:24 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:23:24 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:23:24 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:23:24 user nova-compute[71063]:   </clock>
Apr 11 17:23:24 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:23:24 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:23:24 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:23:24 user nova-compute[71063]:   </cpu>
Apr 11 17:23:24 user nova-compute[71063]:   <devices>
Apr 11 17:23:24 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:23:24 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:23:24 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk"/>
Apr 11 17:23:24 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:23:24 user nova-compute[71063]:     </disk>
Apr 11 17:23:24 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:23:24 user nova-compute[71063]:       <mac address="fa:16:3e:6f:7e:31"/>
Apr 11 17:23:24 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:24 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:23:24 user nova-compute[71063]:       <target dev="tap9e38f2a1-dd"/>
Apr 11 17:23:24 user nova-compute[71063]:     </interface>
Apr 11 17:23:24 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:23:24 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/console.log" append="off"/>
Apr 11 17:23:24 user nova-compute[71063]:     </serial>
Apr 11 17:23:24 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:23:24 user nova-compute[71063]:     <video>
Apr 11 17:23:24 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:24 user nova-compute[71063]:     </video>
Apr 11 17:23:24 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:23:24 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:23:24 user nova-compute[71063]:     </rng>
Apr 11 17:23:24 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:23:24 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:23:24 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:23:24 user nova-compute[71063]:     </memballoon>
Apr 11 17:23:24 user nova-compute[71063]:   </devices>
Apr 11 17:23:24 user nova-compute[71063]: </domain>
Apr 11 17:23:24 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1524069267',display_name='tempest-TestMinimumBasicScenario-server-1524069267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1524069267',id=40,image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiu9qs/8o9kvPO8W0Ojte7aOyHvHP1DL9rJi5LT5sMYD56u8SdO3IgkaWMqrP4DE0Bx/YMDMssf23hFHZssiVzqDM3Ta2uifIuvMqB1k9eG/UXvBn0IVBogGXgha1c2JQ==',key_name='tempest-TestMinimumBasicScenario-1538973025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-7t4iqf09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:22Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=7b2cc7a5-a96b-426e-852c-39b011fe2a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG os_vif [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e38f2a1-dd, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e38f2a1-dd, col_values=(('external_ids', {'iface-id': '9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:7e:31', 'vm-uuid': '7b2cc7a5-a96b-426e-852c-39b011fe2a53'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:24 user nova-compute[71063]: INFO os_vif [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd')
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:23:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No VIF found with MAC fa:16:3e:6f:7e:31, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:23:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated VIF entry in instance network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:26 user nova-compute[71063]: WARNING nova.compute.manager [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state building and task_state spawning.
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:26 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:23:26 user nova-compute[71063]: INFO nova.compute.claims [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Claim successful on node user
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:23:27 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:23:27 user nova-compute[71063]: INFO nova.virt.block_device [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Booting with volume 17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 at /dev/vda
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.policy [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.utils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e901be5-9b91-4274-9aa0-92064c04cc42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8f3f3e-aeb8-4ba2-8685-09fb83578820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb19149-f86c-46d6-9e2d-0c52ef518d2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6a3fac-5732-47ca-b7cd-f6e3dc03079e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:23:27 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:23:27 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[45986635-cbbc-472a-bc2a-bc44aeadd92c]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG os_brick.utils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:23:27 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating existing volume attachment record: 8a2baa55-6a69-438c-b494-10aefba3fd75 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Successfully created port: 56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233808.455845, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] VM Resumed (Lifecycle Event)
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:28 user nova-compute[71063]: WARNING nova.compute.manager [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state building and task_state spawning.
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance spawned successfully.
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233808.461629, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] VM Started (Lifecycle Event)
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Took 6.55 seconds to spawn the instance on the hypervisor.
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:28 user nova-compute[71063]: INFO nova.compute.manager [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Took 7.22 seconds to build instance.
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Successfully updated port: 56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.341s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing instance network info cache due to event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Acquiring lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:28 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating instance_info_cache with network_info: [{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Instance network_info: |[{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Acquired lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updated VIF entry in instance network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating instance_info_cache with network_info: [{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Releasing lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:31 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:23:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Creating image(s)
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Ensure instance console log exists: /opt/stack/data/nova/instances/1f054c2a-84ad-48a6-ad76-8aaf5038c210/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Start _get_guest_xml network_info=[{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': '8a2baa55-6a69-438c-b494-10aefba3fd75', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f054c2a-84ad-48a6-ad76-8aaf5038c210', 'attached_at': '', 'detached_at': '', 'volume_id': '17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'serial': '17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:23:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:32 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:23:32 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:23:32 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:23:32 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca13159-4889-4498-954f-47f7c932725a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:23:32 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fdec4-4ad6-4d21-b92b-70250955b004]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2] added
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[462dc9fd-7404-42ad-9c89-cf1e649563b7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8f2e0-f7de-4da4-a6fd-2cee1a8a3420]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKxwFSaq {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKxwFSaq" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e02f66-ad3d-4f45-a8d0-9232dcad3369]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKxwFSaq'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e759a-6ad8-420e-97d8-ac10119b63e3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc2f538-81ea-4004-a5b0-157ddd0c5bf9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c62467-4359-46f2-aead-b7d0d02765af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]
Apr 11 17:23:32 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4100d9-2995-443e-94e5-6f30368926ac]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1341a20-74cb-4c09-a324-b7fe21241b5f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:23:32 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f06566-931f-408c-97c2-ef29f4dd1aa4]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:23:32 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23161653865376136', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161653865376136', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633641942',display_name='tempest-TestVolumeBootPattern-server-633641942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633641942',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-cfuo6mvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:27Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=1f054c2a-84ad-48a6-ad76-8aaf5038c210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f054c2a-84ad-48a6-ad76-8aaf5038c210 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:23:33 user nova-compute[71063]:   <uuid>1f054c2a-84ad-48a6-ad76-8aaf5038c210</uuid>
Apr 11 17:23:33 user nova-compute[71063]:   <name>instance-00000029</name>
Apr 11 17:23:33 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:23:33 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:23:33 user nova-compute[71063]:   <metadata>
Apr 11 17:23:33 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:23:33 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:23:33 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-server-633641942</nova:name>
Apr 11 17:23:33 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:23:32</nova:creationTime>
Apr 11 17:23:33 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:23:33 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:23:33 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:23:33 user nova-compute[71063]:       <nova:owner>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:23:33 user nova-compute[71063]:       </nova:owner>
Apr 11 17:23:33 user nova-compute[71063]:       <nova:ports>
Apr 11 17:23:33 user nova-compute[71063]:         <nova:port uuid="56ae4ea0-6935-4111-9767-36f6e5d04d93">
Apr 11 17:23:33 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 17:23:33 user nova-compute[71063]:         </nova:port>
Apr 11 17:23:33 user nova-compute[71063]:       </nova:ports>
Apr 11 17:23:33 user nova-compute[71063]:     </nova:instance>
Apr 11 17:23:33 user nova-compute[71063]:   </metadata>
Apr 11 17:23:33 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:23:33 user nova-compute[71063]:     <system>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="serial">1f054c2a-84ad-48a6-ad76-8aaf5038c210</entry>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="uuid">1f054c2a-84ad-48a6-ad76-8aaf5038c210</entry>
Apr 11 17:23:33 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:23:33 user nova-compute[71063]:     </system>
Apr 11 17:23:33 user nova-compute[71063]:   </sysinfo>
Apr 11 17:23:33 user nova-compute[71063]:   <os>
Apr 11 17:23:33 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:23:33 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:23:33 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:23:33 user nova-compute[71063]:   </os>
Apr 11 17:23:33 user nova-compute[71063]:   <features>
Apr 11 17:23:33 user nova-compute[71063]:     <acpi/>
Apr 11 17:23:33 user nova-compute[71063]:     <apic/>
Apr 11 17:23:33 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:23:33 user nova-compute[71063]:   </features>
Apr 11 17:23:33 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:23:33 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:23:33 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:23:33 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:23:33 user nova-compute[71063]:   </clock>
Apr 11 17:23:33 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:23:33 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:23:33 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:23:33 user nova-compute[71063]:   </cpu>
Apr 11 17:23:33 user nova-compute[71063]:   <devices>
Apr 11 17:23:33 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:23:33 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:23:33 user nova-compute[71063]:       <source dev="/dev/sdb"/>
Apr 11 17:23:33 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:23:33 user nova-compute[71063]:       <serial>17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2</serial>
Apr 11 17:23:33 user nova-compute[71063]:     </disk>
Apr 11 17:23:33 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:23:33 user nova-compute[71063]:       <mac address="fa:16:3e:39:51:15"/>
Apr 11 17:23:33 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:33 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:23:33 user nova-compute[71063]:       <target dev="tap56ae4ea0-69"/>
Apr 11 17:23:33 user nova-compute[71063]:     </interface>
Apr 11 17:23:33 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:23:33 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/1f054c2a-84ad-48a6-ad76-8aaf5038c210/console.log" append="off"/>
Apr 11 17:23:33 user nova-compute[71063]:     </serial>
Apr 11 17:23:33 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:23:33 user nova-compute[71063]:     <video>
Apr 11 17:23:33 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:33 user nova-compute[71063]:     </video>
Apr 11 17:23:33 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:23:33 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:23:33 user nova-compute[71063]:     </rng>
Apr 11 17:23:33 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:23:33 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:23:33 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:23:33 user nova-compute[71063]:     </memballoon>
Apr 11 17:23:33 user nova-compute[71063]:   </devices>
Apr 11 17:23:33 user nova-compute[71063]: </domain>
Apr 11 17:23:33 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633641942',display_name='tempest-TestVolumeBootPattern-server-633641942',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633641942',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-cfuo6mvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:27Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=1f054c2a-84ad-48a6-ad76-8aaf5038c210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG os_vif [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56ae4ea0-69, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56ae4ea0-69, col_values=(('external_ids', {'iface-id': '56ae4ea0-6935-4111-9767-36f6e5d04d93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:51:15', 'vm-uuid': '1f054c2a-84ad-48a6-ad76-8aaf5038c210'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:33 user nova-compute[71063]: INFO os_vif [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69')
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:23:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:39:51:15, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:23:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] No waiting events found dispatching network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:35 user nova-compute[71063]: WARNING nova.compute.manager [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received unexpected event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance with vm_state building and task_state spawning.
Apr 11 17:23:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233816.7921882, 1f054c2a-84ad-48a6-ad76-8aaf5038c210 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] VM Resumed (Lifecycle Event)
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Instance spawned successfully.
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233816.8105798, 1f054c2a-84ad-48a6-ad76-8aaf5038c210 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] VM Started (Lifecycle Event)
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:36 user nova-compute[71063]: INFO nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Took 4.91 seconds to spawn the instance on the hypervisor.
Apr 11 17:23:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:37 user nova-compute[71063]: INFO nova.compute.manager [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Took 10.12 seconds to build instance.
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.225s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] No waiting events found dispatching network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:37 user nova-compute[71063]: WARNING nova.compute.manager [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received unexpected event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance with vm_state active and task_state None.
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:23:37 user nova-compute[71063]: INFO nova.compute.claims [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Claim successful on node user
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:23:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.policy [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:23:38 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Creating image(s)
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "/opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "/opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk 1073741824" returned: 0 in 0.058s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:23:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Cannot resize image /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'migration_context' on Instance uuid 8d496845-40fd-4062-91e7-693c7db8a4f3 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Ensure instance console log exists: /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:39 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Successfully created port: 4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Successfully updated port: 4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquired lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-changed-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Refreshing instance network info cache due to event network-changed-4cd65e38-8f39-42d1-b015-f1a6679549b7. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Acquiring lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Updating instance_info_cache with network_info: [{"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Releasing lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Instance network_info: |[{"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Acquired lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.neutron [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Refreshing network info cache for port 4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Start _get_guest_xml network_info=[{"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:23:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:40 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806119957',display_name='tempest-VolumesActionsTest-instance-806119957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806119957',id=42,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-zjcpsw7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:38Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=8d496845-40fd-4062-91e7-693c7db8a4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d496845-40fd-4062-91e7-693c7db8a4f3 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:23:40 user nova-compute[71063]:   <uuid>8d496845-40fd-4062-91e7-693c7db8a4f3</uuid>
Apr 11 17:23:40 user nova-compute[71063]:   <name>instance-0000002a</name>
Apr 11 17:23:40 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:23:40 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:23:40 user nova-compute[71063]:   <metadata>
Apr 11 17:23:40 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:23:40 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:name>tempest-VolumesActionsTest-instance-806119957</nova:name>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:23:40</nova:creationTime>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:23:40 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:23:40 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:owner>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:user uuid="aeef943ec0a0456da8e9b742385ac7f6">tempest-VolumesActionsTest-815942062-project-member</nova:user>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:project uuid="fd4d0572552242c69df31613597ed588">tempest-VolumesActionsTest-815942062</nova:project>
Apr 11 17:23:40 user nova-compute[71063]:       </nova:owner>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:23:40 user nova-compute[71063]:       <nova:ports>
Apr 11 17:23:40 user nova-compute[71063]:         <nova:port uuid="4cd65e38-8f39-42d1-b015-f1a6679549b7">
Apr 11 17:23:40 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:23:40 user nova-compute[71063]:         </nova:port>
Apr 11 17:23:40 user nova-compute[71063]:       </nova:ports>
Apr 11 17:23:40 user nova-compute[71063]:     </nova:instance>
Apr 11 17:23:40 user nova-compute[71063]:   </metadata>
Apr 11 17:23:40 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:23:40 user nova-compute[71063]:     <system>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="serial">8d496845-40fd-4062-91e7-693c7db8a4f3</entry>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="uuid">8d496845-40fd-4062-91e7-693c7db8a4f3</entry>
Apr 11 17:23:40 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:23:40 user nova-compute[71063]:     </system>
Apr 11 17:23:40 user nova-compute[71063]:   </sysinfo>
Apr 11 17:23:40 user nova-compute[71063]:   <os>
Apr 11 17:23:40 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:23:40 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:23:40 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:23:40 user nova-compute[71063]:   </os>
Apr 11 17:23:40 user nova-compute[71063]:   <features>
Apr 11 17:23:40 user nova-compute[71063]:     <acpi/>
Apr 11 17:23:40 user nova-compute[71063]:     <apic/>
Apr 11 17:23:40 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:23:40 user nova-compute[71063]:   </features>
Apr 11 17:23:40 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:23:40 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:23:40 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:23:40 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:23:40 user nova-compute[71063]:   </clock>
Apr 11 17:23:40 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:23:40 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:23:40 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:23:40 user nova-compute[71063]:   </cpu>
Apr 11 17:23:40 user nova-compute[71063]:   <devices>
Apr 11 17:23:40 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:23:40 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:23:40 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk"/>
Apr 11 17:23:40 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:23:40 user nova-compute[71063]:     </disk>
Apr 11 17:23:40 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:23:40 user nova-compute[71063]:       <mac address="fa:16:3e:e1:71:b0"/>
Apr 11 17:23:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:40 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:23:40 user nova-compute[71063]:       <target dev="tap4cd65e38-8f"/>
Apr 11 17:23:40 user nova-compute[71063]:     </interface>
Apr 11 17:23:40 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:23:40 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/console.log" append="off"/>
Apr 11 17:23:40 user nova-compute[71063]:     </serial>
Apr 11 17:23:40 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:23:40 user nova-compute[71063]:     <video>
Apr 11 17:23:40 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:40 user nova-compute[71063]:     </video>
Apr 11 17:23:40 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:23:40 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:23:40 user nova-compute[71063]:     </rng>
Apr 11 17:23:40 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:23:40 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:23:40 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:23:40 user nova-compute[71063]:     </memballoon>
Apr 11 17:23:40 user nova-compute[71063]:   </devices>
Apr 11 17:23:40 user nova-compute[71063]: </domain>
Apr 11 17:23:40 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806119957',display_name='tempest-VolumesActionsTest-instance-806119957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806119957',id=42,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-zjcpsw7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:38Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=8d496845-40fd-4062-91e7-693c7db8a4f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG os_vif [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cd65e38-8f, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4cd65e38-8f, col_values=(('external_ids', {'iface-id': '4cd65e38-8f39-42d1-b015-f1a6679549b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:71:b0', 'vm-uuid': '8d496845-40fd-4062-91e7-693c7db8a4f3'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:23:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:40 user nova-compute[71063]: INFO os_vif [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f')
Apr 11 17:23:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:23:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] No VIF found with MAC fa:16:3e:e1:71:b0, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:23:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Updated VIF entry in instance network info cache for port 4cd65e38-8f39-42d1-b015-f1a6679549b7. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Updating instance_info_cache with network_info: [{"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Releasing lock "refresh_cache-8d496845-40fd-4062-91e7-693c7db8a4f3" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] No waiting events found dispatching network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:42 user nova-compute[71063]: WARNING nova.compute.manager [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received unexpected event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance with vm_state building and task_state spawning.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233824.4587271, 8d496845-40fd-4062-91e7-693c7db8a4f3 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] VM Resumed (Lifecycle Event)
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Instance spawned successfully.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233824.4599729, 8d496845-40fd-4062-91e7-693c7db8a4f3 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] VM Started (Lifecycle Event)
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] No waiting events found dispatching network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:44 user nova-compute[71063]: WARNING nova.compute.manager [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received unexpected event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance with vm_state building and task_state spawning.
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:44 user nova-compute[71063]: INFO nova.compute.manager [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Took 6.82 seconds to build instance.
Apr 11 17:23:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.916s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:23:46 user nova-compute[71063]: INFO nova.compute.claims [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Claim successful on node user
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:23:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.policy [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:23:46 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Creating image(s)
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.205s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.159s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk 1073741824" returned: 0 in 0.060s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.167s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Cannot resize image /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'migration_context' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Ensure instance console log exists: /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:47 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Successfully created port: 50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Successfully updated port: 50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquired lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-changed-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Refreshing instance network info cache due to event network-changed-50e996b3-f103-493c-8b71-348061a520b0. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Acquiring lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.compute.manager [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing instance network info cache due to event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:48 user nova-compute[71063]: DEBUG nova.network.neutron [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating instance_info_cache with network_info: [{"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Releasing lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Instance network_info: |[{"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Acquired lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Refreshing network info cache for port 50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Start _get_guest_xml network_info=[{"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:23:49 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:49 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1945321253',display_name='tempest-AttachVolumeNegativeTest-server-1945321253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1945321253',id=43,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpPWrhpVFdGbf1Dj+4OJg1zutabQuVyX6CAht6XZMDzZuixaz5necKNKPkgnyoYmDHjNVCYHy6lFQCcf7nPglD1D/WKnwp9dX1ijXlmg5LXFi9MHgyyFhA9DYyjhknzpg==',key_name='tempest-keypair-1451399098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-6hbyqmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=3b9f0853-b703-414b-ba98-72215c25f3c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.objects.instance [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:23:49 user nova-compute[71063]:   <uuid>3b9f0853-b703-414b-ba98-72215c25f3c0</uuid>
Apr 11 17:23:49 user nova-compute[71063]:   <name>instance-0000002b</name>
Apr 11 17:23:49 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:23:49 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:23:49 user nova-compute[71063]:   <metadata>
Apr 11 17:23:49 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:23:49 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1945321253</nova:name>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:23:49</nova:creationTime>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:23:49 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:23:49 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:owner>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:user uuid="ff27d08254f74491aba3386c9b901300">tempest-AttachVolumeNegativeTest-1862265490-project-member</nova:user>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:project uuid="23c663a759724bbda32f189ceedf6675">tempest-AttachVolumeNegativeTest-1862265490</nova:project>
Apr 11 17:23:49 user nova-compute[71063]:       </nova:owner>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:23:49 user nova-compute[71063]:       <nova:ports>
Apr 11 17:23:49 user nova-compute[71063]:         <nova:port uuid="50e996b3-f103-493c-8b71-348061a520b0">
Apr 11 17:23:49 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:23:49 user nova-compute[71063]:         </nova:port>
Apr 11 17:23:49 user nova-compute[71063]:       </nova:ports>
Apr 11 17:23:49 user nova-compute[71063]:     </nova:instance>
Apr 11 17:23:49 user nova-compute[71063]:   </metadata>
Apr 11 17:23:49 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:23:49 user nova-compute[71063]:     <system>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="serial">3b9f0853-b703-414b-ba98-72215c25f3c0</entry>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="uuid">3b9f0853-b703-414b-ba98-72215c25f3c0</entry>
Apr 11 17:23:49 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:23:49 user nova-compute[71063]:     </system>
Apr 11 17:23:49 user nova-compute[71063]:   </sysinfo>
Apr 11 17:23:49 user nova-compute[71063]:   <os>
Apr 11 17:23:49 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:23:49 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:23:49 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:23:49 user nova-compute[71063]:   </os>
Apr 11 17:23:49 user nova-compute[71063]:   <features>
Apr 11 17:23:49 user nova-compute[71063]:     <acpi/>
Apr 11 17:23:49 user nova-compute[71063]:     <apic/>
Apr 11 17:23:49 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:23:49 user nova-compute[71063]:   </features>
Apr 11 17:23:49 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:23:49 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:23:49 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:23:49 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:23:49 user nova-compute[71063]:   </clock>
Apr 11 17:23:49 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:23:49 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:23:49 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:23:49 user nova-compute[71063]:   </cpu>
Apr 11 17:23:49 user nova-compute[71063]:   <devices>
Apr 11 17:23:49 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:23:49 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:23:49 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk"/>
Apr 11 17:23:49 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:23:49 user nova-compute[71063]:     </disk>
Apr 11 17:23:49 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:23:49 user nova-compute[71063]:       <mac address="fa:16:3e:5d:d0:62"/>
Apr 11 17:23:49 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:49 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:23:49 user nova-compute[71063]:       <target dev="tap50e996b3-f1"/>
Apr 11 17:23:49 user nova-compute[71063]:     </interface>
Apr 11 17:23:49 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:23:49 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/console.log" append="off"/>
Apr 11 17:23:49 user nova-compute[71063]:     </serial>
Apr 11 17:23:49 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:23:49 user nova-compute[71063]:     <video>
Apr 11 17:23:49 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:23:49 user nova-compute[71063]:     </video>
Apr 11 17:23:49 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:23:49 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:23:49 user nova-compute[71063]:     </rng>
Apr 11 17:23:49 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:23:49 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:23:49 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:23:49 user nova-compute[71063]:     </memballoon>
Apr 11 17:23:49 user nova-compute[71063]:   </devices>
Apr 11 17:23:49 user nova-compute[71063]: </domain>
Apr 11 17:23:49 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1945321253',display_name='tempest-AttachVolumeNegativeTest-server-1945321253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1945321253',id=43,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpPWrhpVFdGbf1Dj+4OJg1zutabQuVyX6CAht6XZMDzZuixaz5necKNKPkgnyoYmDHjNVCYHy6lFQCcf7nPglD1D/WKnwp9dX1ijXlmg5LXFi9MHgyyFhA9DYyjhknzpg==',key_name='tempest-keypair-1451399098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-6hbyqmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=3b9f0853-b703-414b-ba98-72215c25f3c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG os_vif [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50e996b3-f1, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50e996b3-f1, col_values=(('external_ids', {'iface-id': '50e996b3-f103-493c-8b71-348061a520b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:d0:62', 'vm-uuid': '3b9f0853-b703-414b-ba98-72215c25f3c0'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:49 user nova-compute[71063]: INFO os_vif [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1')
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:5d:d0:62, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updated VIF entry in instance network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updated VIF entry in instance network info cache for port 50e996b3-f103-493c-8b71-348061a520b0. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG nova.network.neutron [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating instance_info_cache with network_info: [{"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Releasing lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] No waiting events found dispatching network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:51 user nova-compute[71063]: WARNING nova.compute.manager [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received unexpected event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 for instance with vm_state building and task_state spawning.
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:51 user nova-compute[71063]: INFO nova.compute.manager [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Shelving
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:51 user nova-compute[71063]: WARNING nova.compute.manager [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state active and task_state shelving.
Apr 11 17:23:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance destroyed successfully.
Apr 11 17:23:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Beginning cold snapshot process
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:23:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk /opt/stack/data/nova/instances/snapshots/tmpey5zc90w/9b7d5bcf2cc4416db681c6f244a6e39d {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:23:52 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk /opt/stack/data/nova/instances/snapshots/tmpey5zc90w/9b7d5bcf2cc4416db681c6f244a6e39d" returned: 0 in 0.491s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:23:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Snapshot extracted, beginning image upload
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233832.962063, 3b9f0853-b703-414b-ba98-72215c25f3c0 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:52 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] VM Resumed (Lifecycle Event)
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:52 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Instance spawned successfully.
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:23:52 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:23:53 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233832.964117, 3b9f0853-b703-414b-ba98-72215c25f3c0 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:23:53 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] VM Started (Lifecycle Event)
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] No waiting events found dispatching network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:53 user nova-compute[71063]: WARNING nova.compute.manager [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received unexpected event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 for instance with vm_state building and task_state spawning.
Apr 11 17:23:53 user nova-compute[71063]: INFO nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:53 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:23:53 user nova-compute[71063]: INFO nova.compute.manager [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Took 6.94 seconds to build instance.
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.089s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:23:53 user nova-compute[71063]: WARNING nova.compute.manager [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 17:23:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Snapshot image upload complete
Apr 11 17:23:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:55 user nova-compute[71063]: INFO nova.compute.manager [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Shelve offloading
Apr 11 17:23:55 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance destroyed successfully.
Apr 11 17:23:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:23:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:55 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:55 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance destroyed successfully.
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'resources' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER06UAVi3Q++YC5IiYnLZmfsdNe0rK6icCcgHlC03GX/fdzJHXoeYyuwz1vL6kQvN/1agaN7Felkq60IsaoEVHWhTREOURBecopzDJIXKfwl1FISMDpgIfn5xEca/pyRw==',key_name='tempest-keypair-1845823024',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:23:55.188136',shelved_host='user',shelved_image_id='d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG os_vif [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f57f039-20, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:23:56 user nova-compute[71063]: INFO os_vif [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20')
Apr 11 17:23:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Deleting instance files /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8_del
Apr 11 17:23:56 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Deletion of /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8_del complete
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.compute.manager [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing instance network info cache due to event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:23:56 user nova-compute[71063]: DEBUG nova.network.neutron [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:23:56 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Deleted allocations for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8
Apr 11 17:23:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'numa_topology' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.104s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG nova.network.neutron [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updated VIF entry in instance network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG nova.network.neutron [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9f57f039-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:23:57 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:23:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:04 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:24:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:07 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233832.1263359, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:24:07 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Stopped (Lifecycle Event)
Apr 11 17:24:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-6525d79d-603a-478b-bf22-8c16d2b879cb None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:24:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [{"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-40270cb6-8b7f-4658-8ea8-17a800d63f2d" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:24:10 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:24:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:24:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:24:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:23 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:24:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:24:25 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:24:25 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=26.248085021972656GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:24:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:24:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:24:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:59 user nova-compute[71063]: INFO nova.compute.manager [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Get console output
Apr 11 17:24:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:24:59 user nova-compute[71063]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 17:25:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:13 user nova-compute[71063]: INFO nova.compute.manager [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Attaching volume b2785e1a-385f-4f66-b8fa-db0f5963af98 to /dev/vdb
Apr 11 17:25:13 user nova-compute[71063]: DEBUG os_brick.utils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[71381da3-ac81-4fe3-ae84-ef8b78e586a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:13 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf0e55-9d31-47ea-aa3a-14fda3657654]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137dbad-0b32-4b3a-bcc9-2d8b227e3a8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d02588-ab32-4a70-a0aa-b2f2cf0be663]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:14 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:25:14 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ffbea-b153-4985-9251-1a6d184da640]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG os_brick.utils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:14 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating existing volume attachment record: 6728e344-5d3f-4529-a5f9-f4e27bdb94df {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:25:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYjSyLVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:18 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:18 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:18 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99cc01e-c13b-4ca4-90c6-3d7dafb3b862]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:25:18 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec30a0f-ec2a-43c2-a667-1fcfd2928811]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98] added
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ef6b4-320e-449c-855d-4e2c2a736631]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc8929-d089-4665-a2f4-3602e2d47135]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYjSyLVf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PYjSyLVf" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cfd35a-dba2-4e8e-815e-d4c188775b9c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PYjSyLVf'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7d7212-8091-41f3-908a-d6998b2f975d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6402cb-143c-4fdc-adb1-3892463b2bbd]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3ea2a1-29f5-45e5-b819-dacb17ee71bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260]
Apr 11 17:25:18 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260] successful.
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[53213810-f1aa-4566-9f70-c6e6ea4b3584]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba6931-5511-4485-90ea-72a35780bdd6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:18 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6f92b-1c60-4489-8d32-ac02c1614030]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYjSyLVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG nova.compute.manager [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing instance network info cache due to event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Acquiring lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Acquired lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updated VIF entry in instance network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating instance_info_cache with network_info: [{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Releasing lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26330306336666439', 'path': '/dev/sdc'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330306336666439', 'path': '/dev/sdc'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG nova.objects.instance [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:25:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:25:19 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:25:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:25:19 user nova-compute[71063]:   <serial>b2785e1a-385f-4f66-b8fa-db0f5963af98</serial>
Apr 11 17:25:19 user nova-compute[71063]: </disk>
Apr 11 17:25:19 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:25:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] No VIF found with MAC fa:16:3e:6f:7e:31, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:25:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.287s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:22 user nova-compute[71063]: DEBUG nova.compute.manager [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing instance network info cache due to event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:22 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:22 user nova-compute[71063]: DEBUG nova.network.neutron [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated VIF entry in instance network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:25:24 user nova-compute[71063]: INFO nova.compute.claims [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Claim successful on node user
Apr 11 17:25:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:25:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:25:24 user nova-compute[71063]: INFO nova.virt.block_device [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Booting with volume e180dcbd-cdfe-497e-86e0-e06c5b4c32da at /dev/vda
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.policy [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b7bddc-9104-446b-8661-cc6b5367dfad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a406ee-7630-40ca-8338-d5406cc2557b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d9439c-9c6d-40b5-9657-4cb022938b87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5fcb38-72a9-4e58-9dee-65b976629646]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:24 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:25:24 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd480c60-0b8b-41b1-aff3-e7db82e68540]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG os_brick.utils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:24 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating existing volume attachment record: df785573-0710-4cae-ab1c-6c69cdb0ba74 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing instance network info cache due to event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Successfully created port: ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:25 user nova-compute[71063]: INFO nova.compute.manager [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Rebooting instance
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated VIF entry in instance network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.network.neutron [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Successfully updated port: ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquired lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing instance network info cache due to event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Acquiring lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8188MB free_disk=26.237525939941406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating instance_info_cache with network_info: [{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Releasing lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Instance network_info: |[{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Acquired lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updated VIF entry in instance network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG nova.network.neutron [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating instance_info_cache with network_info: [{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Releasing lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:28 user nova-compute[71063]: INFO nova.compute.manager [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Terminating instance
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-unplugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] No waiting events found dispatching network-vif-unplugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-unplugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:28 user nova-compute[71063]: WARNING nova.compute.manager [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state active and task_state reboot_started.
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Creating image(s)
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Did not create local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Ensure instance console log exists: /opt/stack/data/nova/instances/9d4f216a-af3c-485b-898a-64a2302b8a96/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Start _get_guest_xml network_info=[{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'attachment_id': 'df785573-0710-4cae-ab1c-6c69cdb0ba74', 'delete_on_termination': False, 'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIKMkShF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d4f216a-af3c-485b-898a-64a2302b8a96', 'attached_at': '', 'detached_at': '', 'volume_id': 'e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 'serial': 'e180dcbd-cdfe-497e-86e0-e06c5b4c32da'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:25:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIKMkShF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:29 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:29 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4041f293-bea2-492d-a564-c56111b6f127]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:25:29 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Instance destroyed successfully.
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lazy-loading 'resources' on Instance uuid 8d496845-40fd-4062-91e7-693c7db8a4f3 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-806119957',display_name='tempest-VolumesActionsTest-instance-806119957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-806119957',id=42,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:23:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd4d0572552242c69df31613597ed588',ramdisk_id='',reservation_id='r-zjcpsw7p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-815942062',owner_user_name='tempest-VolumesActionsTest-815942062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:23:45Z,user_data=None,user_id='aeef943ec0a0456da8e9b742385ac7f6',uuid=8d496845-40fd-4062-91e7-693c7db8a4f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converting VIF {"id": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "address": "fa:16:3e:e1:71:b0", "network": {"id": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1749795943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "fd4d0572552242c69df31613597ed588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cd65e38-8f", "ovs_interfaceid": "4cd65e38-8f39-42d1-b015-f1a6679549b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_vif [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6d8fbb-6d4c-432d-a62e-2b1be7d64c9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da] added
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cd65e38-8f, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad328c2-abab-4265-a0cb-9a287e6210d9]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: INFO os_vif [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:71:b0,bridge_name='br-int',has_traffic_filtering=True,id=4cd65e38-8f39-42d1-b015-f1a6679549b7,network=Network(5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cd65e38-8f')
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Deleting instance files /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3_del
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Deletion of /opt/stack/data/nova/instances/8d496845-40fd-4062-91e7-693c7db8a4f3_del complete
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52595b6-6855-4667-856d-9fc336343661]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIKMkShF {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIKMkShF" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e38896-322e-4d8e-a29d-6a101a96ab57]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tIKMkShF'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.compute.manager [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9b970e-3847-47d0-a120-0b4f4e6fa41e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690df74-2c54-439c-b7cb-81fc2e308cf9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance shutdown successfully.
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16eefc4-aabd-44c2-ba54-997c6ab69088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260]
Apr 11 17:25:29 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260] successful.
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3b4b2b-849f-405d-8c56-d7f8f274094b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ddc1e7-ad18-42d1-a1c1-8566ceb6207e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:29 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:29 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7cf93d-5753-486b-b0f7-9f6f6b523234]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIKMkShF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:29 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:30 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Took 0.57 seconds to deallocate network for instance.
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:30 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Deleted allocations for instance 8d496845-40fd-4062-91e7-693c7db8a4f3
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.041s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26338306435363932', 'path': '/dev/sdd'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338306435363932', 'path': '/dev/sdd'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17465943',display_name='tempest-TestVolumeBootPattern-server-17465943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17465943',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-6ihlx04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:25:24Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=9d4f216a-af3c-485b-898a-64a2302b8a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.objects.instance [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d4f216a-af3c-485b-898a-64a2302b8a96 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:25:30 user nova-compute[71063]:   <uuid>9d4f216a-af3c-485b-898a-64a2302b8a96</uuid>
Apr 11 17:25:30 user nova-compute[71063]:   <name>instance-0000002c</name>
Apr 11 17:25:30 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:25:30 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:25:30 user nova-compute[71063]:   <metadata>
Apr 11 17:25:30 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:25:30 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:25:30 user nova-compute[71063]:       <nova:name>tempest-TestVolumeBootPattern-server-17465943</nova:name>
Apr 11 17:25:30 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:25:29</nova:creationTime>
Apr 11 17:25:30 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:25:30 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:25:30 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:25:30 user nova-compute[71063]:       <nova:owner>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:user uuid="c7dcfe84c23f4c0aa80b8f287f0ab004">tempest-TestVolumeBootPattern-665298870-project-member</nova:user>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:project uuid="631ee1e131e94577b853a5ae0886a318">tempest-TestVolumeBootPattern-665298870</nova:project>
Apr 11 17:25:30 user nova-compute[71063]:       </nova:owner>
Apr 11 17:25:30 user nova-compute[71063]:       <nova:ports>
Apr 11 17:25:30 user nova-compute[71063]:         <nova:port uuid="ad0ff01a-d361-4eb0-af56-2afe1460be14">
Apr 11 17:25:30 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:25:30 user nova-compute[71063]:         </nova:port>
Apr 11 17:25:30 user nova-compute[71063]:       </nova:ports>
Apr 11 17:25:30 user nova-compute[71063]:     </nova:instance>
Apr 11 17:25:30 user nova-compute[71063]:   </metadata>
Apr 11 17:25:30 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:25:30 user nova-compute[71063]:     <system>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="serial">9d4f216a-af3c-485b-898a-64a2302b8a96</entry>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="uuid">9d4f216a-af3c-485b-898a-64a2302b8a96</entry>
Apr 11 17:25:30 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:25:30 user nova-compute[71063]:     </system>
Apr 11 17:25:30 user nova-compute[71063]:   </sysinfo>
Apr 11 17:25:30 user nova-compute[71063]:   <os>
Apr 11 17:25:30 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:25:30 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:25:30 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:25:30 user nova-compute[71063]:   </os>
Apr 11 17:25:30 user nova-compute[71063]:   <features>
Apr 11 17:25:30 user nova-compute[71063]:     <acpi/>
Apr 11 17:25:30 user nova-compute[71063]:     <apic/>
Apr 11 17:25:30 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:25:30 user nova-compute[71063]:   </features>
Apr 11 17:25:30 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:25:30 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:25:30 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:25:30 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:25:30 user nova-compute[71063]:   </clock>
Apr 11 17:25:30 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:25:30 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:25:30 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:25:30 user nova-compute[71063]:   </cpu>
Apr 11 17:25:30 user nova-compute[71063]:   <devices>
Apr 11 17:25:30 user nova-compute[71063]:     <disk type="block" device="disk">
Apr 11 17:25:30 user nova-compute[71063]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:25:30 user nova-compute[71063]:       <source dev="/dev/sdd"/>
Apr 11 17:25:30 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:25:30 user nova-compute[71063]:       <serial>e180dcbd-cdfe-497e-86e0-e06c5b4c32da</serial>
Apr 11 17:25:30 user nova-compute[71063]:     </disk>
Apr 11 17:25:30 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:25:30 user nova-compute[71063]:       <mac address="fa:16:3e:0a:18:de"/>
Apr 11 17:25:30 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:25:30 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:25:30 user nova-compute[71063]:       <target dev="tapad0ff01a-d3"/>
Apr 11 17:25:30 user nova-compute[71063]:     </interface>
Apr 11 17:25:30 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:25:30 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/9d4f216a-af3c-485b-898a-64a2302b8a96/console.log" append="off"/>
Apr 11 17:25:30 user nova-compute[71063]:     </serial>
Apr 11 17:25:30 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:25:30 user nova-compute[71063]:     <video>
Apr 11 17:25:30 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:25:30 user nova-compute[71063]:     </video>
Apr 11 17:25:30 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:25:30 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:25:30 user nova-compute[71063]:     </rng>
Apr 11 17:25:30 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:25:30 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:25:30 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:25:30 user nova-compute[71063]:     </memballoon>
Apr 11 17:25:30 user nova-compute[71063]:   </devices>
Apr 11 17:25:30 user nova-compute[71063]: </domain>
Apr 11 17:25:30 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17465943',display_name='tempest-TestVolumeBootPattern-server-17465943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17465943',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-6ihlx04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:25:24Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=9d4f216a-af3c-485b-898a-64a2302b8a96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG os_vif [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad0ff01a-d3, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapad0ff01a-d3, col_values=(('external_ids', {'iface-id': 'ad0ff01a-d361-4eb0-af56-2afe1460be14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:18:de', 'vm-uuid': '9d4f216a-af3c-485b-898a-64a2302b8a96'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: INFO os_vif [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3')
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Acquiring lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Lock "8d496845-40fd-4062-91e7-693c7db8a4f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] No waiting events found dispatching network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:30 user nova-compute[71063]: WARNING nova.compute.manager [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received unexpected event network-vif-plugged-4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance with vm_state deleted and task_state None.
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Received event network-vif-deleted-4cd65e38-8f39-42d1-b015-f1a6679549b7 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] No VIF found with MAC fa:16:3e:0a:18:de, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:30 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:30 user nova-compute[71063]: WARNING nova.compute.manager [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state active and task_state reboot_started.
Apr 11 17:25:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:32 user nova-compute[71063]: DEBUG nova.compute.manager [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] No waiting events found dispatching network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:32 user nova-compute[71063]: WARNING nova.compute.manager [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received unexpected event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance with vm_state building and task_state spawning.
Apr 11 17:25:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:33 user nova-compute[71063]: WARNING nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state active and task_state reboot_started.
Apr 11 17:25:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:33 user nova-compute[71063]: DEBUG nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:33 user nova-compute[71063]: WARNING nova.compute.manager [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state active and task_state reboot_started.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.host [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Removed pending event for 7b2cc7a5-a96b-426e-852c-39b011fe2a53 due to event {{(pid=71063) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233934.196794, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] VM Resumed (Lifecycle Event)
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance running successfully.
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance soft rebooted successfully.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233934.197831, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] VM Started (Lifecycle Event)
Apr 11 17:25:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.602s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233934.4887822, 9d4f216a-af3c-485b-898a-64a2302b8a96 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] VM Resumed (Lifecycle Event)
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Instance spawned successfully.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] No waiting events found dispatching network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:34 user nova-compute[71063]: WARNING nova.compute.manager [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received unexpected event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance with vm_state building and task_state spawning.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233934.7963533, 9d4f216a-af3c-485b-898a-64a2302b8a96 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] VM Started (Lifecycle Event)
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:25:34 user nova-compute[71063]: INFO nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 11 17:25:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:35 user nova-compute[71063]: INFO nova.compute.manager [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Took 11.09 seconds to build instance.
Apr 11 17:25:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.250s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:35 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:25:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-changed-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Refreshing instance network info cache due to event network-changed-50e996b3-f103-493c-8b71-348061a520b0. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Acquiring lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Acquired lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Refreshing network info cache for port 50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updated VIF entry in instance network info cache for port 50e996b3-f103-493c-8b71-348061a520b0. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating instance_info_cache with network_info: [{"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Releasing lock "refresh_cache-3b9f0853-b703-414b-ba98-72215c25f3c0" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:39 user nova-compute[71063]: INFO nova.compute.manager [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Attaching volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c to /dev/vdb
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.utils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e4f902-2335-4547-a7e2-090ff72ad7e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2d07f-db00-44f3-9163-c4e09aa6c5d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e0457-c741-4cf2-9ec5-fba31b2e3de8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde3178-4cbb-4c8c-8f4c-3fc76dbb11d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:25:39 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:25:39 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c50c2f4-57ef-4033-aa9b-7b9ecc31928b]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG os_brick.utils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:39 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating existing volume attachment record: e0eb8bc5-2abd-43c8-9e7d-8643167c936c {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:25:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiaqUnQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:43 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:43 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:43 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e0a0e6-4a17-477c-a3c1-559e66e48f78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:25:43 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f1f18-a8cd-4696-a53d-984e4bb419b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c] added
Apr 11 17:25:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6bb42-f4db-4c42-bf71-3411b332a24b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[38181249-8d06-44dd-bc38-52053e1d5569]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiaqUnQM {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KiaqUnQM" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef738d-3c23-48ac-a561-24c113d439c1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KiaqUnQM'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bffaac-cd1c-4526-8711-e44af36251f9]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f2c72-6e56-46c4-ad4e-5edd1f418b91]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:43 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:43 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:43 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9df77d-35d8-4b78-9cff-7b7b61c43793]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260]
Apr 11 17:25:44 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260] successful.
Apr 11 17:25:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1a59b2-bb4d-40f7-8bff-c3d2a0c81055]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:44 user nova-compute[71063]: INFO nova.compute.manager [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Unshelving
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d896b402-4db9-42d1-ba3e-b5497c178097]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)
Apr 11 17:25:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:44 user nova-compute[71063]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)
Apr 11 17:25:44 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HCTL ('37', '-', '-', 0) found on session 48 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa36616-1acb-46ab-a912-dfa8b8ec9f1a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Searching for a device in session 48 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiaqUnQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_requests' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'numa_topology' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:25:44 user nova-compute[71063]: INFO nova.compute.claims [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Claim successful on node user
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233929.2968545, 8d496845-40fd-4062-91e7-693c7db8a4f3 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:44 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] VM Stopped (Lifecycle Event)
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.compute.manager [None req-16a700b4-7b77-4454-bf48-01b28f3d89c7 None None] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:25:44 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:44 user nova-compute[71063]: INFO nova.network.neutron [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating port 9f57f039-208c-41c2-93cd-7df0ca44218f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23630383166316164', 'path': '/dev/sdf'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630383166316164', 'path': '/dev/sdf'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:25:45 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:25:45 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:25:45 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:25:45 user nova-compute[71063]:   <serial>3d88a41a-dae7-4a3d-adea-c9187ab4dd5c</serial>
Apr 11 17:25:45 user nova-compute[71063]: </disk>
Apr 11 17:25:45 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.compute.manager [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing instance network info cache due to event network-changed-9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Acquiring lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:5d:d0:62, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.547s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.network.neutron [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:25:45 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Creating image(s)
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Acquired lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG nova.network.neutron [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Refreshing network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:45 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.part --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:46 user nova-compute[71063]: DEBUG nova.virt.images [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb was qcow2, converting to raw {{(pid=71063) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 17:25:46 user nova-compute[71063]: DEBUG nova.privsep.utils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71063) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 17:25:46 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.part /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.converted {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.part /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.converted" returned: 0 in 0.315s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.converted --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.network.neutron [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updated VIF entry in instance network info cache for port 9f57f039-208c-41c2-93cd-7df0ca44218f. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.network.neutron [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Releasing lock "refresh_cache-e5c59a1a-121c-41c4-8ca4-b6675b5191c8" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.402s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json" returned: 0 in 0.149s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b,backing_fmt=raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b,backing_fmt=raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk 1073741824" returned: 0 in 0.070s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "8576dabd080bdf6f0c59dfa3e2fbde802636f16b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:47 user nova-compute[71063]: INFO nova.compute.manager [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Detaching volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c
Apr 11 17:25:47 user nova-compute[71063]: INFO nova.virt.block_device [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Attempting to driver detach volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c from mountpoint /dev/vdb
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8576dabd080bdf6f0c59dfa3e2fbde802636f16b --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'migration_context' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Rebasing disk image.
Apr 11 17:25:47 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Attempting to detach device vdb from instance 3b9f0853-b703-414b-ba98-72215c25f3c0 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:25:47 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:25:47 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:25:47 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:25:47 user nova-compute[71063]:   <serial>3d88a41a-dae7-4a3d-adea-c9187ab4dd5c</serial>
Apr 11 17:25:47 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:25:47 user nova-compute[71063]: </disk>
Apr 11 17:25:47 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:25:47 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance 3b9f0853-b703-414b-ba98-72215c25f3c0 from the persistent domain config.
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b9f0853-b703-414b-ba98-72215c25f3c0 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:25:47 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:25:47 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:25:47 user nova-compute[71063]:   <source dev="/dev/sdf"/>
Apr 11 17:25:47 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:25:47 user nova-compute[71063]:   <serial>3d88a41a-dae7-4a3d-adea-c9187ab4dd5c</serial>
Apr 11 17:25:47 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:25:47 user nova-compute[71063]: </disk>
Apr 11 17:25:47 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 -F raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681233948.3407588, 3b9f0853-b703-414b-ba98-72215c25f3c0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:25:48 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance 3b9f0853-b703-414b-ba98-72215c25f3c0 from the live domain config.
Apr 11 17:25:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KiaqUnQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:25:48 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1502c9cc-3c6a-4103-8d53-c1eb2b571dbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:25:48 user nova-compute[71063]: No targets found.
Apr 11 17:25:48 user nova-compute[71063]: iSNS:
Apr 11 17:25:48 user nova-compute[71063]: No targets found.
Apr 11 17:25:48 user nova-compute[71063]: STATIC:
Apr 11 17:25:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c
Apr 11 17:25:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:25:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:25:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:25:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:25:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:25:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:25:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:25:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:25:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98
Apr 11 17:25:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:25:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:25:48 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da
Apr 11 17:25:48 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:25:48 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:25:48 user nova-compute[71063]: FIRMWARE:
Apr 11 17:25:48 user nova-compute[71063]: No targets found.
Apr 11 17:25:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:25:48 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:25:48 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb2ece2-89fe-4354-992b-c22e9d078153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8d0bd9-8fc8-4914-b5b0-1d6bffc1bfe6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)
Apr 11 17:25:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:25:48 user nova-compute[71063]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c (non-flash)
Apr 11 17:25:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbec16b56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c'): ({'sdf'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Removing single pathed devices sdf {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c738030f-5173-4047-a87a-d8287de9d7b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[03991f28-05bd-4e35-816f-2a4780f72704]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flushing IO for device /dev/sdf {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e176f0-1813-461f-9ad0-023b9daf18c6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9aab05-fa60-4654-a206-4e250aa0938d]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] SCSI volumes sdf have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c3b01-8d14-42c2-8fca-e6208a69c806]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7571af9b-18da-45e0-9dd2-b40facbea57e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260]
Apr 11 17:25:48 user nova-compute[71063]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c, portal: 172.16.0.220,3260] successful.
Apr 11 17:25:48 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88a41a-dae7-4a3d-adea-c9187ab4dd5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5059ef76-a41d-429e-a6b4-00948ee80398]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== disconnect_volume: return (308ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:25:48 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:25:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:49 user nova-compute[71063]: DEBUG nova.objects.instance [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:49 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.154s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 -F raw /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk" returned: 0 in 2.400s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Ensure instance console log exists: /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start _get_guest_xml network_info=[{"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3095b8b0ad22cb23cdbc3eee87445f5c',container_format='bare',created_at=2023-04-11T17:23:51Z,direct_url=<?>,disk_format='qcow2',id=d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1970963305-shelved',owner='fce268052b8046e5a7efa41048e96645',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T17:23:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:25:50 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:50 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3095b8b0ad22cb23cdbc3eee87445f5c',container_format='bare',created_at=2023-04-11T17:23:51Z,direct_url=<?>,disk_format='qcow2',id=d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1970963305-shelved',owner='fce268052b8046e5a7efa41048e96645',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T17:23:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1845823024',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:23:55.188136',shelved_host='user',shelved_image_id='d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'pci_devices' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:25:50 user nova-compute[71063]:   <uuid>e5c59a1a-121c-41c4-8ca4-b6675b5191c8</uuid>
Apr 11 17:25:50 user nova-compute[71063]:   <name>instance-00000027</name>
Apr 11 17:25:50 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:25:50 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:25:50 user nova-compute[71063]:   <metadata>
Apr 11 17:25:50 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:25:50 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1970963305</nova:name>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:25:50</nova:creationTime>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:25:50 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:25:50 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:owner>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:user uuid="b69069a1461d485598e2078cc12772a5">tempest-AttachVolumeShelveTestJSON-2051096798-project-member</nova:user>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:project uuid="fce268052b8046e5a7efa41048e96645">tempest-AttachVolumeShelveTestJSON-2051096798</nova:project>
Apr 11 17:25:50 user nova-compute[71063]:       </nova:owner>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:root type="image" uuid="d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb"/>
Apr 11 17:25:50 user nova-compute[71063]:       <nova:ports>
Apr 11 17:25:50 user nova-compute[71063]:         <nova:port uuid="9f57f039-208c-41c2-93cd-7df0ca44218f">
Apr 11 17:25:50 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 17:25:50 user nova-compute[71063]:         </nova:port>
Apr 11 17:25:50 user nova-compute[71063]:       </nova:ports>
Apr 11 17:25:50 user nova-compute[71063]:     </nova:instance>
Apr 11 17:25:50 user nova-compute[71063]:   </metadata>
Apr 11 17:25:50 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:25:50 user nova-compute[71063]:     <system>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="serial">e5c59a1a-121c-41c4-8ca4-b6675b5191c8</entry>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="uuid">e5c59a1a-121c-41c4-8ca4-b6675b5191c8</entry>
Apr 11 17:25:50 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:25:50 user nova-compute[71063]:     </system>
Apr 11 17:25:50 user nova-compute[71063]:   </sysinfo>
Apr 11 17:25:50 user nova-compute[71063]:   <os>
Apr 11 17:25:50 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:25:50 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:25:50 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:25:50 user nova-compute[71063]:   </os>
Apr 11 17:25:50 user nova-compute[71063]:   <features>
Apr 11 17:25:50 user nova-compute[71063]:     <acpi/>
Apr 11 17:25:50 user nova-compute[71063]:     <apic/>
Apr 11 17:25:50 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:25:50 user nova-compute[71063]:   </features>
Apr 11 17:25:50 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:25:50 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:25:50 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:25:50 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:25:50 user nova-compute[71063]:   </clock>
Apr 11 17:25:50 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:25:50 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:25:50 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:25:50 user nova-compute[71063]:   </cpu>
Apr 11 17:25:50 user nova-compute[71063]:   <devices>
Apr 11 17:25:50 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:25:50 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:25:50 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk"/>
Apr 11 17:25:50 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:25:50 user nova-compute[71063]:     </disk>
Apr 11 17:25:50 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:25:50 user nova-compute[71063]:       <mac address="fa:16:3e:e2:d7:89"/>
Apr 11 17:25:50 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:25:50 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:25:50 user nova-compute[71063]:       <target dev="tap9f57f039-20"/>
Apr 11 17:25:50 user nova-compute[71063]:     </interface>
Apr 11 17:25:50 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:25:50 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/console.log" append="off"/>
Apr 11 17:25:50 user nova-compute[71063]:     </serial>
Apr 11 17:25:50 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:25:50 user nova-compute[71063]:     <video>
Apr 11 17:25:50 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:25:50 user nova-compute[71063]:     </video>
Apr 11 17:25:50 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:25:50 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:25:50 user nova-compute[71063]:     </rng>
Apr 11 17:25:50 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:25:50 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:25:50 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:25:50 user nova-compute[71063]:     </memballoon>
Apr 11 17:25:50 user nova-compute[71063]:   </devices>
Apr 11 17:25:50 user nova-compute[71063]: </domain>
Apr 11 17:25:50 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1845823024',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member',shelved_at='2023-04-11T17:23:55.188136',shelved_host='user',shelved_image_id='d9177a1b-d5f2-4403-9aa0-d89dbb42e3bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:25:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG os_vif [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f57f039-20, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f57f039-20, col_values=(('external_ids', {'iface-id': '9f57f039-208c-41c2-93cd-7df0ca44218f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:d7:89', 'vm-uuid': 'e5c59a1a-121c-41c4-8ca4-b6675b5191c8'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:50 user nova-compute[71063]: INFO os_vif [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20')
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:25:50 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] No VIF found with MAC fa:16:3e:e2:d7:89, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:25:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG nova.compute.manager [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:52 user nova-compute[71063]: WARNING nova.compute.manager [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:25:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:52 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:25:54 user nova-compute[71063]: WARNING nova.compute.manager [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233954.2531648, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:54 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Resumed (Lifecycle Event)
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:25:54 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance spawned successfully.
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:54 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681233954.2554686, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:25:54 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Started (Lifecycle Event)
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:25:54 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:25:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:25:54 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.546s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:25:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:25:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:00 user nova-compute[71063]: INFO nova.compute.manager [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Terminating instance
Apr 11 17:26:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG nova.compute.manager [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-unplugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Instance destroyed successfully.
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 40270cb6-8b7f-4658-8ea8-17a800d63f2d {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-95786467',display_name='tempest-ServerActionsTestJSON-server-95786467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-95786467',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-syqmjuw5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:23:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=40270cb6-8b7f-4658-8ea8-17a800d63f2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "09360ccd-e24b-449a-9e15-b86a5a12b501", "address": "fa:16:3e:0f:63:dc", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09360ccd-e2", "ovs_interfaceid": "09360ccd-e24b-449a-9e15-b86a5a12b501", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_vif [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09360ccd-e2, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:26:01 user nova-compute[71063]: INFO os_vif [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:63:dc,bridge_name='br-int',has_traffic_filtering=True,id=09360ccd-e24b-449a-9e15-b86a5a12b501,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09360ccd-e2')
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDQPsBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:26:01 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66b8f2-3233-4540-900a-9abd3b5f0c85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:26:01 user nova-compute[71063]: No targets found.
Apr 11 17:26:01 user nova-compute[71063]: iSNS:
Apr 11 17:26:01 user nova-compute[71063]: No targets found.
Apr 11 17:26:01 user nova-compute[71063]: STATIC:
Apr 11 17:26:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01
Apr 11 17:26:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:26:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:26:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:26:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:26:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:26:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98
Apr 11 17:26:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:26:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:26:01 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da
Apr 11 17:26:01 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:26:01 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:26:01 user nova-compute[71063]: FIRMWARE:
Apr 11 17:26:01 user nova-compute[71063]: No targets found.
Apr 11 17:26:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:26:01 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:26:01 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2aa7ef-74bb-4808-923a-e24d8b2663e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[864ab5d6-8ce8-4918-ae41-aebc9356b983]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:26:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:26:01 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:26:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe804ad750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01'): ({'sde'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Removing single pathed devices sde {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3df0389-94a1-4786-90b5-47c839f9825c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fc9f09-a476-4ed9-8a6e-a5268003b744]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flushing IO for device /dev/sde {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[548766a4-4f12-4107-977d-81f77c047fab]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c827f8a-d2f2-4e89-9be3-ca162123fcad]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] SCSI volumes sde have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d7c315f', '/dev/disk/by-id/scsi-1SCST_BIO5d7c315f-1d31d1a49c98a4c7', '/dev/disk/by-id/scsi-23164333164316134') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:26:01 user nova-compute[71063]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_5d7c315f
Apr 11 17:26:01 user nova-compute[71063]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO5d7c315f-1d31d1a49c98a4c7
Apr 11 17:26:01 user nova-compute[71063]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23164333164316134
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a49ef-1539-48ac-8939-91e682dd90f0]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f21fcf-35bc-4ddd-ba38-627348d34f29]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a7872-3426-42fa-b091-f644fe82d095]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260]
Apr 11 17:26:01 user nova-compute[71063]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01, portal: 172.16.0.220,3260] successful.
Apr 11 17:26:01 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2bead45a-38fa-42b7-bd54-8c1f88c67e01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0c51c-f556-411f-ac09-f9d6e2ccf8d5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] <== disconnect_volume: return (322ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:26:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Deleting instance files /opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d_del
Apr 11 17:26:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Deletion of /opt/stack/data/nova/instances/40270cb6-8b7f-4658-8ea8-17a800d63f2d_del complete
Apr 11 17:26:01 user nova-compute[71063]: INFO nova.compute.manager [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 17:26:01 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:26:01 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:02 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Took 0.68 seconds to deallocate network for instance.
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-deleted-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:02 user nova-compute[71063]: INFO nova.compute.manager [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Neutron deleted interface 09360ccd-e24b-449a-9e15-b86a5a12b501; detaching it from the instance and deleting it from the info cache
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.network.neutron [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Detach interface failed, port_id=09360ccd-e24b-449a-9e15-b86a5a12b501, reason: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Acquiring lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.compute.manager [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] No waiting events found dispatching network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:02 user nova-compute[71063]: WARNING nova.compute.manager [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Received unexpected event network-vif-plugged-09360ccd-e24b-449a-9e15-b86a5a12b501 for instance with vm_state active and task_state deleting.
Apr 11 17:26:02 user nova-compute[71063]: INFO nova.compute.manager [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 17:26:02 user nova-compute[71063]: DEBUG nova.compute.manager [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Deleting volume: 2bead45a-38fa-42b7-bd54-8c1f88c67e01 {{(pid=71063) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 17:26:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:03 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:26:03 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:26:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:03 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Deleted allocations for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d
Apr 11 17:26:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "40270cb6-8b7f-4658-8ea8-17a800d63f2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 70a306a5-f981-495f-9f3a-8fd5011b4ce1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [{"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-70a306a5-f981-495f-9f3a-8fd5011b4ce1" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:26:13 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:16 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233961.080233, 40270cb6-8b7f-4658-8ea8-17a800d63f2d => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:26:16 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] VM Stopped (Lifecycle Event)
Apr 11 17:26:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-07457095-9ad6-46bf-8165-fd00787bf5f8 None None] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:26:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:26:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:26:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:26:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:26:26 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:26:26 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:26:26 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8062MB free_disk=26.234577178955078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:26:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:26:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:38 user nova-compute[71063]: INFO nova.compute.manager [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Terminating instance
Apr 11 17:26:38 user nova-compute[71063]: DEBUG nova.compute.manager [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-unplugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] No waiting events found dispatching network-vif-unplugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-unplugged-50e996b3-f103-493c-8b71-348061a520b0 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Instance destroyed successfully.
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'resources' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1945321253',display_name='tempest-AttachVolumeNegativeTest-server-1945321253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1945321253',id=43,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpPWrhpVFdGbf1Dj+4OJg1zutabQuVyX6CAht6XZMDzZuixaz5necKNKPkgnyoYmDHjNVCYHy6lFQCcf7nPglD1D/WKnwp9dX1ijXlmg5LXFi9MHgyyFhA9DYyjhknzpg==',key_name='tempest-keypair-1451399098',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:23:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-6hbyqmn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=3b9f0853-b703-414b-ba98-72215c25f3c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "50e996b3-f103-493c-8b71-348061a520b0", "address": "fa:16:3e:5d:d0:62", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50e996b3-f1", "ovs_interfaceid": "50e996b3-f103-493c-8b71-348061a520b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG os_vif [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50e996b3-f1, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:26:39 user nova-compute[71063]: INFO os_vif [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:d0:62,bridge_name='br-int',has_traffic_filtering=True,id=50e996b3-f103-493c-8b71-348061a520b0,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50e996b3-f1')
Apr 11 17:26:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Deleting instance files /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0_del
Apr 11 17:26:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Deletion of /opt/stack/data/nova/instances/3b9f0853-b703-414b-ba98-72215c25f3c0_del complete
Apr 11 17:26:40 user nova-compute[71063]: INFO nova.compute.manager [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Took 1.55 seconds to destroy the instance on the hypervisor.
Apr 11 17:26:40 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:26:40 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:26:40 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:41 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Took 1.14 seconds to deallocate network for instance.
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-deleted-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:41 user nova-compute[71063]: INFO nova.compute.manager [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Neutron deleted interface 50e996b3-f103-493c-8b71-348061a520b0; detaching it from the instance and deleting it from the info cache
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.network.neutron [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Detach interface failed, port_id=50e996b3-f103-493c-8b71-348061a520b0, reason: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. {{(pid=71063) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:41 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Deleted allocations for instance 3b9f0853-b703-414b-ba98-72215c25f3c0
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.187s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Acquiring lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Lock "3b9f0853-b703-414b-ba98-72215c25f3c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] No waiting events found dispatching network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:41 user nova-compute[71063]: WARNING nova.compute.manager [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Received unexpected event network-vif-plugged-50e996b3-f103-493c-8b71-348061a520b0 for instance with vm_state deleted and task_state None.
Apr 11 17:26:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:50 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:50 user nova-compute[71063]: INFO nova.compute.manager [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Terminating instance
Apr 11 17:26:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-unplugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] No waiting events found dispatching network-vif-unplugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-unplugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:26:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Instance destroyed successfully.
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.objects.instance [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'resources' on Instance uuid 70a306a5-f981-495f-9f3a-8fd5011b4ce1 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1640703286',display_name='tempest-ServerActionsTestJSON-server-1640703286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1640703286',id=33,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q==',key_name='tempest-keypair-1019962913',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db242f5f39d94966948e8b487cd52d0c',ramdisk_id='',reservation_id='r-zr190i4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-499420188',owner_user_name='tempest-ServerActionsTestJSON-499420188-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4ba7d7f3f74b5c800be2408c1035e2',uuid=70a306a5-f981-495f-9f3a-8fd5011b4ce1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converting VIF {"id": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "address": "fa:16:3e:5e:b3:2a", "network": {"id": "a3d41d47-6b37-4493-ac8f-572031c1a620", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1609098204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db242f5f39d94966948e8b487cd52d0c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3246a9-9a", "ovs_interfaceid": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG os_vif [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a3246a9-9a, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:26:51 user nova-compute[71063]: INFO os_vif [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:b3:2a,bridge_name='br-int',has_traffic_filtering=True,id=2a3246a9-9ae1-4f3e-9e23-37c3702e9879,network=Network(a3d41d47-6b37-4493-ac8f-572031c1a620),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3246a9-9a')
Apr 11 17:26:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Deleting instance files /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1_del
Apr 11 17:26:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Deletion of /opt/stack/data/nova/instances/70a306a5-f981-495f-9f3a-8fd5011b4ce1_del complete
Apr 11 17:26:51 user nova-compute[71063]: INFO nova.compute.manager [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 17:26:51 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:26:51 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:26:52 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:26:52 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Took 0.49 seconds to deallocate network for instance.
Apr 11 17:26:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:52 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:26:52 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:26:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:52 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Deleted allocations for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1
Apr 11 17:26:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Acquiring lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:26:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:26:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Lock "70a306a5-f981-495f-9f3a-8fd5011b4ce1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:26:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] No waiting events found dispatching network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:26:53 user nova-compute[71063]: WARNING nova.compute.manager [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received unexpected event network-vif-plugged-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance with vm_state deleted and task_state None.
Apr 11 17:26:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Received event network-vif-deleted-2a3246a9-9ae1-4f3e-9e23-37c3702e9879 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:26:54 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681233999.9471786, 3b9f0853-b703-414b-ba98-72215c25f3c0 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:26:54 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] VM Stopped (Lifecycle Event)
Apr 11 17:26:54 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e2501f5f-1eb2-4c3a-935f-10ce717ad421 None None] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:26:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:26:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234011.591749, 70a306a5-f981-495f-9f3a-8fd5011b4ce1 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:27:06 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] VM Stopped (Lifecycle Event)
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ab211b87-a755-4462-b733-6554ea5c72cf None None] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:27:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:14 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:14 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG nova.compute.manager [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing instance network info cache due to event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Acquiring lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Acquired lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:15 user nova-compute[71063]: DEBUG nova.network.neutron [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updated VIF entry in instance network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating instance_info_cache with network_info: [{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Releasing lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.compute.manager [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing instance network info cache due to event network-changed-ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Acquiring lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Acquired lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.network.neutron [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Refreshing network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:16 user nova-compute[71063]: INFO nova.compute.manager [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Terminating instance
Apr 11 17:27:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Instance destroyed successfully.
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid 9d4f216a-af3c-485b-898a-64a2302b8a96 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:25:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-17465943',display_name='tempest-TestVolumeBootPattern-server-17465943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-17465943',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:25:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-6ihlx04f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:25:35Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=9d4f216a-af3c-485b-898a-64a2302b8a96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_vif [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad0ff01a-d3, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:17 user nova-compute[71063]: INFO os_vif [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:18:de,bridge_name='br-int',has_traffic_filtering=True,id=ad0ff01a-d361-4eb0-af56-2afe1460be14,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad0ff01a-d3')
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIKMkShF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:27:17 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[10179d1e-81cd-4ade-9356-026dfdce4f5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:27:17 user nova-compute[71063]: No targets found.
Apr 11 17:27:17 user nova-compute[71063]: iSNS:
Apr 11 17:27:17 user nova-compute[71063]: No targets found.
Apr 11 17:27:17 user nova-compute[71063]: STATIC:
Apr 11 17:27:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:27:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:27:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:27:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98
Apr 11 17:27:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:27:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:27:17 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da
Apr 11 17:27:17 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:27:17 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:27:17 user nova-compute[71063]: FIRMWARE:
Apr 11 17:27:17 user nova-compute[71063]: No targets found.
Apr 11 17:27:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:27:17 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:27:17 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad530cb-2f1c-4f13-b319-00156b227d90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3be725-6f71-4327-b0e0-795c135797ce]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:27:17 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:27:17 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:27:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:27:17 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:27:17 user nova-compute[71063]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da (non-flash)
Apr 11 17:27:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe8045c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da'): ({'sdd'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdd {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a53d06b-c70f-4dbe-9c0b-879ff9a51857]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f50ef3-affb-48d1-9c6f-59c2cba9d911]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdd {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd34c68-289a-4a2c-96de-0cb81a90cd51]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e3c65-0fd6-4866-949b-d526cdc2f451]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdd have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338306435363932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aef82f94', '/dev/disk/by-id/scsi-1SCST_BIOaef82f94-c80d5692f911aa10') {{(pid=81529) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de9cf81-c9d9-4e4a-ac9c-c95f36152eeb]: (4, None) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be939c-63d9-4322-8239-ee0e03a64b77]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522c746-25a3-43ef-b23d-3fc6e5709dd3]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260]
Apr 11 17:27:17 user nova-compute[71063]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da, portal: 172.16.0.220,3260] successful.
Apr 11 17:27:17 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e180dcbd-cdfe-497e-86e0-e06c5b4c32da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aaf960-3c70-4ee3-806a-f0ab4f8bedd3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (317ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:27:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Deleting instance files /opt/stack/data/nova/instances/9d4f216a-af3c-485b-898a-64a2302b8a96_del
Apr 11 17:27:17 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Deletion of /opt/stack/data/nova/instances/9d4f216a-af3c-485b-898a-64a2302b8a96_del complete
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updated VIF entry in instance network info cache for port ad0ff01a-d361-4eb0-af56-2afe1460be14. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating instance_info_cache with network_info: [{"id": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "address": "fa:16:3e:0a:18:de", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad0ff01a-d3", "ovs_interfaceid": "ad0ff01a-d361-4eb0-af56-2afe1460be14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:17 user nova-compute[71063]: INFO nova.compute.manager [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Releasing lock "refresh_cache-9d4f216a-af3c-485b-898a-64a2302b8a96" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-unplugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] No waiting events found dispatching network-vif-unplugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-unplugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.compute.manager [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing instance network info cache due to event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:17 user nova-compute[71063]: DEBUG nova.network.neutron [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:27:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:27:18 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:18 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Took 0.58 seconds to deallocate network for instance.
Apr 11 17:27:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated VIF entry in instance network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:27:18 user nova-compute[71063]: DEBUG nova.network.neutron [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.compute.manager [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing instance network info cache due to event network-changed-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Acquiring lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Acquired lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Refreshing network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.compute.manager [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Detaching volume b2785e1a-385f-4f66-b8fa-db0f5963af98
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.virt.block_device [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Attempting to driver detach volume b2785e1a-385f-4f66-b8fa-db0f5963af98 from mountpoint /dev/vdb
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Attempting to detach device vdb from instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:27:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:27:19 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:27:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:27:19 user nova-compute[71063]:   <serial>b2785e1a-385f-4f66-b8fa-db0f5963af98</serial>
Apr 11 17:27:19 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:27:19 user nova-compute[71063]: </disk>
Apr 11 17:27:19 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully detached device vdb from instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 from the persistent domain config.
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:27:19 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:27:19 user nova-compute[71063]:   <source dev="/dev/sdc"/>
Apr 11 17:27:19 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:27:19 user nova-compute[71063]:   <serial>b2785e1a-385f-4f66-b8fa-db0f5963af98</serial>
Apr 11 17:27:19 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:27:19 user nova-compute[71063]: </disk>
Apr 11 17:27:19 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.compute.manager [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Took 0.89 seconds to detach 1 volumes for instance.
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updated VIF entry in instance network info cache for port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.network.neutron [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [{"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Releasing lock "refresh_cache-7b2cc7a5-a96b-426e-852c-39b011fe2a53" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance 9d4f216a-af3c-485b-898a-64a2302b8a96
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234039.7924988, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:27:19 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully detached device vdb from instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 from the live domain config.
Apr 11 17:27:19 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PYjSyLVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:27:19 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fbde2-c633-43f0-86e6-bb9843e7ce9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:27:19 user nova-compute[71063]: No targets found.
Apr 11 17:27:19 user nova-compute[71063]: iSNS:
Apr 11 17:27:19 user nova-compute[71063]: No targets found.
Apr 11 17:27:19 user nova-compute[71063]: STATIC:
Apr 11 17:27:19 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:27:19 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:27:19 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:27:19 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98
Apr 11 17:27:19 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:27:19 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:27:19 user nova-compute[71063]: FIRMWARE:
Apr 11 17:27:19 user nova-compute[71063]: No targets found.
Apr 11 17:27:19 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:27:19 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:27:19 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc1eb39-b138-4ce1-bdd2-78b9604e05a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7132b195-75b7-46f7-84f9-4f509a551d44]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:27:19 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:27:19 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:27:19 user nova-compute[71063]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 (non-flash)
Apr 11 17:27:19 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbebf2463b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98'): ({'sdc'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Removing single pathed devices sdc {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1498de0b-4d52-4cc9-ba40-287cf902c2af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3cb095-3c68-4c93-b0b1-96e2000efe53]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flushing IO for device /dev/sdc {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a1e12-daf1-46b5-8f73-50b0900ab38e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:27:19 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfa59c5-ef60-4415-a3ba-6dc89d80595f]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] SCSI volumes sdc have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Acquiring lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Lock "9d4f216a-af3c-485b-898a-64a2302b8a96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] No waiting events found dispatching network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:20 user nova-compute[71063]: WARNING nova.compute.manager [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received unexpected event network-vif-plugged-ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance with vm_state deleted and task_state None.
Apr 11 17:27:20 user nova-compute[71063]: DEBUG nova.compute.manager [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Received event network-vif-deleted-ad0ff01a-d361-4eb0-af56-2afe1460be14 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3a1e90-43cf-4f67-a477-271b3c928600]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe09856-3a37-4b31-a049-245448005814]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260]
Apr 11 17:27:20 user nova-compute[71063]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98, portal: 172.16.0.220,3260] successful.
Apr 11 17:27:20 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2785e1a-385f-4f66-b8fa-db0f5963af98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed3be2-f0e5-4728-8469-b85538e2d29a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] <== disconnect_volume: return (321ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG nova.objects.instance [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'flavor' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:27:20 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:22 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71063) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:27:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=26.262195587158203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:27:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234037.4679387, 9d4f216a-af3c-485b-898a-64a2302b8a96 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:27:32 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] VM Stopped (Lifecycle Event)
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-cad88c53-578b-4f91-8f03-51bc011993e6 None None] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:27:32 user nova-compute[71063]: INFO nova.compute.claims [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Claim successful on node user
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:27:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.policy [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:27:32 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Creating image(s)
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "/opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.170s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk 1073741824" returned: 0 in 0.050s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Cannot resize image /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'migration_context' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Ensure instance console log exists: /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:33 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Successfully created port: 2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:34 user nova-compute[71063]: INFO nova.compute.manager [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Terminating instance
Apr 11 17:27:34 user nova-compute[71063]: DEBUG nova.compute.manager [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:34 user nova-compute[71063]: DEBUG nova.compute.manager [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-unplugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Successfully updated port: 2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquired lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-changed-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.compute.manager [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Refreshing instance network info cache due to event network-changed-2b3a5d7c-36dd-4752-81ff-b52dd20899e1. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Acquiring lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:27:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Instance destroyed successfully.
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'resources' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T17:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1970963305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1970963305',id=39,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER06UAVi3Q++YC5IiYnLZmfsdNe0rK6icCcgHlC03GX/fdzJHXoeYyuwz1vL6kQvN/1agaN7Felkq60IsaoEVHWhTREOURBecopzDJIXKfwl1FISMDpgIfn5xEca/pyRw==',key_name='tempest-keypair-1845823024',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:25:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fce268052b8046e5a7efa41048e96645',ramdisk_id='',reservation_id='r-m00w727c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2051096798',owner_user_name='tempest-AttachVolumeShelveTestJSON-2051096798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:25:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b69069a1461d485598e2078cc12772a5',uuid=e5c59a1a-121c-41c4-8ca4-b6675b5191c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converting VIF {"id": "9f57f039-208c-41c2-93cd-7df0ca44218f", "address": "fa:16:3e:e2:d7:89", "network": {"id": "ab158a7f-12de-4735-97b5-6ffa89762d09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1016362384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fce268052b8046e5a7efa41048e96645", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f57f039-20", "ovs_interfaceid": "9f57f039-208c-41c2-93cd-7df0ca44218f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG os_vif [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f57f039-20, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:35 user nova-compute[71063]: INFO os_vif [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d7:89,bridge_name='br-int',has_traffic_filtering=True,id=9f57f039-208c-41c2-93cd-7df0ca44218f,network=Network(ab158a7f-12de-4735-97b5-6ffa89762d09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f57f039-20')
Apr 11 17:27:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Deleting instance files /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8_del
Apr 11 17:27:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Deletion of /opt/stack/data/nova/instances/e5c59a1a-121c-41c4-8ca4-b6675b5191c8_del complete
Apr 11 17:27:35 user nova-compute[71063]: INFO nova.compute.manager [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating instance_info_cache with network_info: [{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Releasing lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Instance network_info: |[{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Acquired lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Refreshing network info cache for port 2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Start _get_guest_xml network_info=[{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:27:35 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:27:35 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832781409',display_name='tempest-AttachVolumeNegativeTest-server-1832781409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832781409',id=45,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjg6y5c4bWzxie1RNFs/ruXDTwr9qyR6V7QApxc9dx7meAMZb0t2pHrv+9TjRRauBB9uzs9qyo+QKd+sjmfFNUwSjqtKGcMeN9je+lKciRvzvtoxCGx3G5zz+z8zj+Lag==',key_name='tempest-keypair-50229463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-g0eltgr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=4d149c96-1eca-4e4c-8165-e56fcfb1f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:27:35 user nova-compute[71063]:   <uuid>4d149c96-1eca-4e4c-8165-e56fcfb1f730</uuid>
Apr 11 17:27:35 user nova-compute[71063]:   <name>instance-0000002d</name>
Apr 11 17:27:35 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:27:35 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:27:35 user nova-compute[71063]:   <metadata>
Apr 11 17:27:35 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:27:35 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1832781409</nova:name>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:27:35</nova:creationTime>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:27:35 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:27:35 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:owner>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:user uuid="ff27d08254f74491aba3386c9b901300">tempest-AttachVolumeNegativeTest-1862265490-project-member</nova:user>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:project uuid="23c663a759724bbda32f189ceedf6675">tempest-AttachVolumeNegativeTest-1862265490</nova:project>
Apr 11 17:27:35 user nova-compute[71063]:       </nova:owner>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:27:35 user nova-compute[71063]:       <nova:ports>
Apr 11 17:27:35 user nova-compute[71063]:         <nova:port uuid="2b3a5d7c-36dd-4752-81ff-b52dd20899e1">
Apr 11 17:27:35 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 17:27:35 user nova-compute[71063]:         </nova:port>
Apr 11 17:27:35 user nova-compute[71063]:       </nova:ports>
Apr 11 17:27:35 user nova-compute[71063]:     </nova:instance>
Apr 11 17:27:35 user nova-compute[71063]:   </metadata>
Apr 11 17:27:35 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:27:35 user nova-compute[71063]:     <system>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="serial">4d149c96-1eca-4e4c-8165-e56fcfb1f730</entry>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="uuid">4d149c96-1eca-4e4c-8165-e56fcfb1f730</entry>
Apr 11 17:27:35 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:27:35 user nova-compute[71063]:     </system>
Apr 11 17:27:35 user nova-compute[71063]:   </sysinfo>
Apr 11 17:27:35 user nova-compute[71063]:   <os>
Apr 11 17:27:35 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:27:35 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:27:35 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:27:35 user nova-compute[71063]:   </os>
Apr 11 17:27:35 user nova-compute[71063]:   <features>
Apr 11 17:27:35 user nova-compute[71063]:     <acpi/>
Apr 11 17:27:35 user nova-compute[71063]:     <apic/>
Apr 11 17:27:35 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:27:35 user nova-compute[71063]:   </features>
Apr 11 17:27:35 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:27:35 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:27:35 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:27:35 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:27:35 user nova-compute[71063]:   </clock>
Apr 11 17:27:35 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:27:35 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:27:35 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:27:35 user nova-compute[71063]:   </cpu>
Apr 11 17:27:35 user nova-compute[71063]:   <devices>
Apr 11 17:27:35 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:27:35 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:27:35 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk"/>
Apr 11 17:27:35 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:27:35 user nova-compute[71063]:     </disk>
Apr 11 17:27:35 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:27:35 user nova-compute[71063]:       <mac address="fa:16:3e:0c:a3:d5"/>
Apr 11 17:27:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:27:35 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:27:35 user nova-compute[71063]:       <target dev="tap2b3a5d7c-36"/>
Apr 11 17:27:35 user nova-compute[71063]:     </interface>
Apr 11 17:27:35 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:27:35 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/console.log" append="off"/>
Apr 11 17:27:35 user nova-compute[71063]:     </serial>
Apr 11 17:27:35 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:27:35 user nova-compute[71063]:     <video>
Apr 11 17:27:35 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:27:35 user nova-compute[71063]:     </video>
Apr 11 17:27:35 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:27:35 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:27:35 user nova-compute[71063]:     </rng>
Apr 11 17:27:35 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:27:35 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:27:35 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:27:35 user nova-compute[71063]:     </memballoon>
Apr 11 17:27:35 user nova-compute[71063]:   </devices>
Apr 11 17:27:35 user nova-compute[71063]: </domain>
Apr 11 17:27:35 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832781409',display_name='tempest-AttachVolumeNegativeTest-server-1832781409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832781409',id=45,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjg6y5c4bWzxie1RNFs/ruXDTwr9qyR6V7QApxc9dx7meAMZb0t2pHrv+9TjRRauBB9uzs9qyo+QKd+sjmfFNUwSjqtKGcMeN9je+lKciRvzvtoxCGx3G5zz+z8zj+Lag==',key_name='tempest-keypair-50229463',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-g0eltgr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=4d149c96-1eca-4e4c-8165-e56fcfb1f730,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG os_vif [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b3a5d7c-36, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b3a5d7c-36, col_values=(('external_ids', {'iface-id': '2b3a5d7c-36dd-4752-81ff-b52dd20899e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:a3:d5', 'vm-uuid': '4d149c96-1eca-4e4c-8165-e56fcfb1f730'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:35 user nova-compute[71063]: INFO os_vif [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36')
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:0c:a3:d5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:27:35 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:35 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Took 0.66 seconds to deallocate network for instance.
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-deleted-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updated VIF entry in instance network info cache for port 2b3a5d7c-36dd-4752-81ff-b52dd20899e1. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.network.neutron [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating instance_info_cache with network_info: [{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Releasing lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:36 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Deleted allocations for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Acquiring lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Lock "e5c59a1a-121c-41c4-8ca4-b6675b5191c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG nova.compute.manager [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] No waiting events found dispatching network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:36 user nova-compute[71063]: WARNING nova.compute.manager [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Received unexpected event network-vif-plugged-9f57f039-208c-41c2-93cd-7df0ca44218f for instance with vm_state deleted and task_state None.
Apr 11 17:27:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] No waiting events found dispatching network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:37 user nova-compute[71063]: WARNING nova.compute.manager [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received unexpected event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance with vm_state building and task_state spawning.
Apr 11 17:27:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234059.0789185, 4d149c96-1eca-4e4c-8165-e56fcfb1f730 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] VM Resumed (Lifecycle Event)
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Instance spawned successfully.
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234059.0799072, 4d149c96-1eca-4e4c-8165-e56fcfb1f730 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] VM Started (Lifecycle Event)
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Took 6.21 seconds to spawn the instance on the hypervisor.
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:39 user nova-compute[71063]: INFO nova.compute.manager [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Took 6.79 seconds to build instance.
Apr 11 17:27:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:27:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] No waiting events found dispatching network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:27:39 user nova-compute[71063]: WARNING nova.compute.manager [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received unexpected event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance with vm_state active and task_state None.
Apr 11 17:27:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:43 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:50 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234055.2140863, e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:27:50 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] VM Stopped (Lifecycle Event)
Apr 11 17:27:50 user nova-compute[71063]: DEBUG nova.compute.manager [None req-a8c6aaba-ac08-409b-bdac-314bc353ffe1 None None] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:27:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:27:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:00 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:00 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:28:01 user nova-compute[71063]: INFO nova.compute.claims [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Claim successful on node user
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:28:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.policy [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cde9c28bb4f84dc7bb865446203e54eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8aed1a07fb4244ad9ec8c8d9816a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:28:01 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Creating image(s)
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "/opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "/opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.143s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.145s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk 1073741824" returned: 0 in 0.071s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:01 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.142s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Cannot resize image /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lazy-loading 'migration_context' on Instance uuid 8bee1911-3859-4292-8bc5-4572963aa007 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Ensure instance console log exists: /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:02 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Successfully created port: c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Successfully updated port: c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquired lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-changed-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG nova.compute.manager [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Refreshing instance network info cache due to event network-changed-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Acquiring lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:28:03 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Updating instance_info_cache with network_info: [{"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Releasing lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Instance network_info: |[{"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Acquired lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Refreshing network info cache for port c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Start _get_guest_xml network_info=[{"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:28:04 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:28:04 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1316453602',display_name='tempest-VolumesNegativeTest-instance-1316453602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1316453602',id=46,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8aed1a07fb4244ad9ec8c8d9816a27',ramdisk_id='',reservation_id='r-0ad8gqy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2079915658',owner_user_name='tempest-VolumesNegativeTest-2079915658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:28:01Z,user_data=None,user_id='cde9c28bb4f84dc7bb865446203e54eb',uuid=8bee1911-3859-4292-8bc5-4572963aa007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converting VIF {"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bee1911-3859-4292-8bc5-4572963aa007 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:28:04 user nova-compute[71063]:   <uuid>8bee1911-3859-4292-8bc5-4572963aa007</uuid>
Apr 11 17:28:04 user nova-compute[71063]:   <name>instance-0000002e</name>
Apr 11 17:28:04 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:28:04 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:28:04 user nova-compute[71063]:   <metadata>
Apr 11 17:28:04 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:28:04 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:name>tempest-VolumesNegativeTest-instance-1316453602</nova:name>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:28:04</nova:creationTime>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:28:04 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:28:04 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:owner>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:user uuid="cde9c28bb4f84dc7bb865446203e54eb">tempest-VolumesNegativeTest-2079915658-project-member</nova:user>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:project uuid="0f8aed1a07fb4244ad9ec8c8d9816a27">tempest-VolumesNegativeTest-2079915658</nova:project>
Apr 11 17:28:04 user nova-compute[71063]:       </nova:owner>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:28:04 user nova-compute[71063]:       <nova:ports>
Apr 11 17:28:04 user nova-compute[71063]:         <nova:port uuid="c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1">
Apr 11 17:28:04 user nova-compute[71063]:           <nova:ip type="fixed" address="192.168.233.97" ipVersion="4"/>
Apr 11 17:28:04 user nova-compute[71063]:         </nova:port>
Apr 11 17:28:04 user nova-compute[71063]:       </nova:ports>
Apr 11 17:28:04 user nova-compute[71063]:     </nova:instance>
Apr 11 17:28:04 user nova-compute[71063]:   </metadata>
Apr 11 17:28:04 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:28:04 user nova-compute[71063]:     <system>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="serial">8bee1911-3859-4292-8bc5-4572963aa007</entry>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="uuid">8bee1911-3859-4292-8bc5-4572963aa007</entry>
Apr 11 17:28:04 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:28:04 user nova-compute[71063]:     </system>
Apr 11 17:28:04 user nova-compute[71063]:   </sysinfo>
Apr 11 17:28:04 user nova-compute[71063]:   <os>
Apr 11 17:28:04 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:28:04 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:28:04 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:28:04 user nova-compute[71063]:   </os>
Apr 11 17:28:04 user nova-compute[71063]:   <features>
Apr 11 17:28:04 user nova-compute[71063]:     <acpi/>
Apr 11 17:28:04 user nova-compute[71063]:     <apic/>
Apr 11 17:28:04 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:28:04 user nova-compute[71063]:   </features>
Apr 11 17:28:04 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:28:04 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:28:04 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:28:04 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:28:04 user nova-compute[71063]:   </clock>
Apr 11 17:28:04 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:28:04 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:28:04 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:28:04 user nova-compute[71063]:   </cpu>
Apr 11 17:28:04 user nova-compute[71063]:   <devices>
Apr 11 17:28:04 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:28:04 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:28:04 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk"/>
Apr 11 17:28:04 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:28:04 user nova-compute[71063]:     </disk>
Apr 11 17:28:04 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:28:04 user nova-compute[71063]:       <mac address="fa:16:3e:ed:e0:76"/>
Apr 11 17:28:04 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:28:04 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:28:04 user nova-compute[71063]:       <target dev="tapc32a4b0d-6d"/>
Apr 11 17:28:04 user nova-compute[71063]:     </interface>
Apr 11 17:28:04 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:28:04 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/console.log" append="off"/>
Apr 11 17:28:04 user nova-compute[71063]:     </serial>
Apr 11 17:28:04 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:28:04 user nova-compute[71063]:     <video>
Apr 11 17:28:04 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:28:04 user nova-compute[71063]:     </video>
Apr 11 17:28:04 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:28:04 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:28:04 user nova-compute[71063]:     </rng>
Apr 11 17:28:04 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:28:04 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:28:04 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:28:04 user nova-compute[71063]:     </memballoon>
Apr 11 17:28:04 user nova-compute[71063]:   </devices>
Apr 11 17:28:04 user nova-compute[71063]: </domain>
Apr 11 17:28:04 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1316453602',display_name='tempest-VolumesNegativeTest-instance-1316453602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1316453602',id=46,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f8aed1a07fb4244ad9ec8c8d9816a27',ramdisk_id='',reservation_id='r-0ad8gqy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2079915658',owner_user_name='tempest-VolumesNegativeTest-2079915658-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:28:01Z,user_data=None,user_id='cde9c28bb4f84dc7bb865446203e54eb',uuid=8bee1911-3859-4292-8bc5-4572963aa007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converting VIF {"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG os_vif [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc32a4b0d-6d, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc32a4b0d-6d, col_values=(('external_ids', {'iface-id': 'c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e0:76', 'vm-uuid': '8bee1911-3859-4292-8bc5-4572963aa007'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:04 user nova-compute[71063]: INFO os_vif [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d')
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] No VIF found with MAC fa:16:3e:ed:e0:76, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Updated VIF entry in instance network info cache for port c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG nova.network.neutron [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Updating instance_info_cache with network_info: [{"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:28:04 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Releasing lock "refresh_cache-8bee1911-3859-4292-8bc5-4572963aa007" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:05 user nova-compute[71063]: DEBUG nova.compute.manager [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] No waiting events found dispatching network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:05 user nova-compute[71063]: WARNING nova.compute.manager [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received unexpected event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance with vm_state building and task_state spawning.
Apr 11 17:28:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234087.7954614, 8bee1911-3859-4292-8bc5-4572963aa007 => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] VM Resumed (Lifecycle Event)
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Instance spawned successfully.
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234087.7987738, 8bee1911-3859-4292-8bc5-4572963aa007 => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] VM Started (Lifecycle Event)
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Took 6.34 seconds to spawn the instance on the hypervisor.
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:07 user nova-compute[71063]: DEBUG nova.compute.manager [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] No waiting events found dispatching network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:07 user nova-compute[71063]: WARNING nova.compute.manager [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received unexpected event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance with vm_state building and task_state spawning.
Apr 11 17:28:07 user nova-compute[71063]: INFO nova.compute.manager [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Took 6.95 seconds to build instance.
Apr 11 17:28:08 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing instance network info cache due to event network-changed-56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Acquiring lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Acquired lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Refreshing network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:10 user nova-compute[71063]: INFO nova.compute.manager [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Terminating instance
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updated VIF entry in instance network info cache for port 56ae4ea0-6935-4111-9767-36f6e5d04d93. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.network.neutron [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating instance_info_cache with network_info: [{"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Releasing lock "refresh_cache-1f054c2a-84ad-48a6-ad76-8aaf5038c210" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-unplugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] No waiting events found dispatching network-vif-unplugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-unplugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:10 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:10 user nova-compute[71063]: INFO nova.compute.manager [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Terminating instance
Apr 11 17:28:10 user nova-compute[71063]: DEBUG nova.compute.manager [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Instance destroyed successfully.
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lazy-loading 'resources' on Instance uuid 1f054c2a-84ad-48a6-ad76-8aaf5038c210 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-633641942',display_name='tempest-TestVolumeBootPattern-server-633641942',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-633641942',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg==',key_name='tempest-TestVolumeBootPattern-967443343',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='631ee1e131e94577b853a5ae0886a318',ramdisk_id='',reservation_id='r-cfuo6mvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-665298870',owner_user_name='tempest-TestVolumeBootPattern-665298870-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:23:37Z,user_data=None,user_id='c7dcfe84c23f4c0aa80b8f287f0ab004',uuid=1f054c2a-84ad-48a6-ad76-8aaf5038c210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converting VIF {"id": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "address": "fa:16:3e:39:51:15", "network": {"id": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-101723840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "631ee1e131e94577b853a5ae0886a318", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56ae4ea0-69", "ovs_interfaceid": "56ae4ea0-6935-4111-9767-36f6e5d04d93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_vif [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56ae4ea0-69, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: INFO os_vif [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:51:15,bridge_name='br-int',has_traffic_filtering=True,id=56ae4ea0-6935-4111-9767-36f6e5d04d93,network=Network(dd04c0b8-1ba3-450d-9eab-fd88096ba41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56ae4ea0-69')
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKxwFSaq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:28:11 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3a8a95-af8a-40f8-83f4-bc9d8762040e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:28:11 user nova-compute[71063]: No targets found.
Apr 11 17:28:11 user nova-compute[71063]: iSNS:
Apr 11 17:28:11 user nova-compute[71063]: No targets found.
Apr 11 17:28:11 user nova-compute[71063]: STATIC:
Apr 11 17:28:11 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2
Apr 11 17:28:11 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:28:11 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:28:11 user nova-compute[71063]: FIRMWARE:
Apr 11 17:28:11 user nova-compute[71063]: No targets found.
Apr 11 17:28:11 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:28:11 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:28:11 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e249087-764e-4856-94d5-cfeca81e96c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.compute.manager [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-unplugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1399f110-3ce2-479f-82f1-a17ce0c116c4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:28:11 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 (non-flash)
Apr 11 17:28:11 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80403370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4207664-212e-4e5c-bbd9-2258a5ec0596]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d1c95-9056-493a-8a10-99f42c1af9a3]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f356fd-2bc7-45b2-a502-e8942722caf5]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f75d910-d661-4dae-8761-6c5181745397]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518d855-0c11-45dc-b2b5-52c3704b32f9]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba480c-24b4-4a23-8c89-cf2c270d71c5]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260]
Apr 11 17:28:11 user nova-compute[71063]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2, portal: 172.16.0.220,3260] successful.
Apr 11 17:28:11 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa5b91e-8309-4cb7-adbc-2386d89c6bb7]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] <== disconnect_volume: return (325ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Deleting instance files /opt/stack/data/nova/instances/1f054c2a-84ad-48a6-ad76-8aaf5038c210_del
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Deletion of /opt/stack/data/nova/instances/1f054c2a-84ad-48a6-ad76-8aaf5038c210_del complete
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.compute.manager [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Instance destroyed successfully.
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.objects.instance [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'resources' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:23:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1524069267',display_name='tempest-TestMinimumBasicScenario-server-1524069267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1524069267',id=40,image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiu9qs/8o9kvPO8W0Ojte7aOyHvHP1DL9rJi5LT5sMYD56u8SdO3IgkaWMqrP4DE0Bx/YMDMssf23hFHZssiVzqDM3Ta2uifIuvMqB1k9eG/UXvBn0IVBogGXgha1c2JQ==',key_name='tempest-TestMinimumBasicScenario-1538973025',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:23:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab7ce3fc251f4f1eb9151d1ef8c86d91',ramdisk_id='',reservation_id='r-7t4iqf09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='137b317a-9b41-43a6-8479-f72f88cdf361',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-593818068',owner_user_name='tempest-TestMinimumBasicScenario-593818068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:25:34Z,user_data=None,user_id='eed61e2d73a84d85a9f5ff2b314624c9',uuid=7b2cc7a5-a96b-426e-852c-39b011fe2a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converting VIF {"id": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "address": "fa:16:3e:6f:7e:31", "network": {"id": "e8339c3d-c984-4d1a-b01d-b64e5aec1392", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1520225719-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab7ce3fc251f4f1eb9151d1ef8c86d91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38f2a1-dd", "ovs_interfaceid": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG os_vif [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e38f2a1-dd, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:11 user nova-compute[71063]: INFO os_vif [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:7e:31,bridge_name='br-int',has_traffic_filtering=True,id=9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638,network=Network(e8339c3d-c984-4d1a-b01d-b64e5aec1392),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38f2a1-dd')
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Deleting instance files /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53_del
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Deletion of /opt/stack/data/nova/instances/7b2cc7a5-a96b-426e-852c-39b011fe2a53_del complete
Apr 11 17:28:11 user nova-compute[71063]: INFO nova.compute.manager [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 17:28:11 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:28:11 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:28:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Took 0.52 seconds to deallocate network for instance.
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:28:12 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Took 0.51 seconds to deallocate network for instance.
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-deleted-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:12 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Deleted allocations for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Acquiring lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:12 user nova-compute[71063]: DEBUG nova.compute.manager [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] No waiting events found dispatching network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:12 user nova-compute[71063]: WARNING nova.compute.manager [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received unexpected event network-vif-plugged-56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance with vm_state active and task_state deleting.
Apr 11 17:28:12 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:12 user nova-compute[71063]: INFO nova.compute.manager [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Took 0.87 seconds to detach 1 volumes for instance.
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:13 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Deleted allocations for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210
Apr 11 17:28:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Acquiring lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Lock "7b2cc7a5-a96b-426e-852c-39b011fe2a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] No waiting events found dispatching network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:28:13 user nova-compute[71063]: WARNING nova.compute.manager [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Received unexpected event network-vif-plugged-9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance with vm_state deleted and task_state None.
Apr 11 17:28:13 user nova-compute[71063]: DEBUG nova.compute.manager [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Received event network-vif-deleted-56ae4ea0-6935-4111-9767-36f6e5d04d93 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:28:13 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "1f054c2a-84ad-48a6-ad76-8aaf5038c210" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.047s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:28:14 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:28:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:28:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:28:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234091.098234, 1f054c2a-84ad-48a6-ad76-8aaf5038c210 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:28:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] VM Stopped (Lifecycle Event)
Apr 11 17:28:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-96c1e071-f218-4605-b18f-1f7d9a50e476 None None] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234091.7102869, 7b2cc7a5-a96b-426e-852c-39b011fe2a53 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:28:26 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] VM Stopped (Lifecycle Event)
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8770da7b-06cf-4bc6-8577-0a11f65beb72 None None] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:28:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:28:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:28:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8465MB free_disk=26.257415771484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 8bee1911-3859-4292-8bc5-4572963aa007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:28:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:28:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:41 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:46 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:28:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:28:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:29:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:03 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:07 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating instance_info_cache with network_info: [{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:29:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:29:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:29:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:29:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-changed-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG nova.compute.manager [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Refreshing instance network info cache due to event network-changed-2b3a5d7c-36dd-4752-81ff-b52dd20899e1. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Acquiring lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Acquired lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:29:23 user nova-compute[71063]: DEBUG nova.network.neutron [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Refreshing network info cache for port 2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:29:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updated VIF entry in instance network info cache for port 2b3a5d7c-36dd-4752-81ff-b52dd20899e1. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:29:24 user nova-compute[71063]: DEBUG nova.network.neutron [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating instance_info_cache with network_info: [{"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:29:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Releasing lock "refresh_cache-4d149c96-1eca-4e4c-8165-e56fcfb1f730" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG nova.objects.instance [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:25 user nova-compute[71063]: INFO nova.compute.manager [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Attaching volume 79fb9a22-498c-4c30-bd46-567c0cac048b to /dev/vdb
Apr 11 17:29:25 user nova-compute[71063]: DEBUG os_brick.utils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1ef7a1-c8eb-425d-8828-880af862ba70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52e4df-b098-4718-ae2f-4b016b6c9873]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f9f52-deaa-48f5-849f-6183bcd4f840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0699fe-0b12-4b72-82b9-e466918a400e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:25 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:29:26 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c555d6-78c5-4b6d-aaf9-1a3314676931]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG os_brick.utils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating existing volume attachment record: e32a8304-967e-4ec6-a34d-7681009b8f46 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:26 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:29:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=26.258277893066406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 8bee1911-3859-4292-8bc5-4572963aa007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:29:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:29:28 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:29:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RecdQTnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:29:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:29:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:29:30 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[db031517-4d19-472d-b963-47dfd7bad289]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:29:30 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477cb5f-4d09-4d2c-b571-31b5eae03f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b] added
Apr 11 17:29:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[36382482-d1cb-4259-b188-addb0fe95271]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5463b3b-9999-4b7d-bcb0-e39d37fac62e]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RecdQTnG {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RecdQTnG" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[119362ba-01d4-42c1-889a-1aa14ef4e1dd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RecdQTnG'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[603a73e6-5f6d-48c1-873d-b68f574fa3cb]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c384151a-e671-48f4-8523-2550f8080b0b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:29:30 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:29:30 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:29:30 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:29:30 user nova-compute[71063]: 
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c2c11-e457-4cf3-a34f-4ab1429f1737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260]
Apr 11 17:29:30 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260] successful.
Apr 11 17:29:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c717e003-5f76-4cc6-82f7-6af3f1a19fd8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd713b69-760b-4b8f-a742-e8dab15ec62f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)
Apr 11 17:29:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)
Apr 11 17:29:30 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce54318-5e7d-4c37-a93d-488d13e5609a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RecdQTnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:29:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23231363432373230', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231363432373230', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.objects.instance [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:29:31 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:29:31 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:29:31 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:29:31 user nova-compute[71063]:   <serial>79fb9a22-498c-4c30-bd46-567c0cac048b</serial>
Apr 11 17:29:31 user nova-compute[71063]: </disk>
Apr 11 17:29:31 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:29:31 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] No VIF found with MAC fa:16:3e:0c:a3:d5, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Triggering sync for uuid 8bee1911-3859-4292-8bc5-4572963aa007 {{(pid=71063) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "8bee1911-3859-4292-8bc5-4572963aa007" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "8bee1911-3859-4292-8bc5-4572963aa007" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:33 user nova-compute[71063]: INFO nova.compute.manager [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Detaching volume 79fb9a22-498c-4c30-bd46-567c0cac048b
Apr 11 17:29:33 user nova-compute[71063]: INFO nova.virt.block_device [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Attempting to driver detach volume 79fb9a22-498c-4c30-bd46-567c0cac048b from mountpoint /dev/vdb
Apr 11 17:29:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Attempting to detach device vdb from instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:29:33 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:29:33 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:29:33 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:29:33 user nova-compute[71063]:   <serial>79fb9a22-498c-4c30-bd46-567c0cac048b</serial>
Apr 11 17:29:33 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:29:33 user nova-compute[71063]: </disk>
Apr 11 17:29:33 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:29:33 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 from the persistent domain config.
Apr 11 17:29:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:29:33 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:29:33 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:29:33 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:29:33 user nova-compute[71063]:   <serial>79fb9a22-498c-4c30-bd46-567c0cac048b</serial>
Apr 11 17:29:33 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:29:33 user nova-compute[71063]: </disk>
Apr 11 17:29:33 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234173.9968228, 4d149c96-1eca-4e4c-8165-e56fcfb1f730 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:29:34 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully detached device vdb from instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 from the live domain config.
Apr 11 17:29:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RecdQTnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:29:34 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee1436-855a-4198-b6b9-3d4aeb305f81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:29:34 user nova-compute[71063]: No targets found.
Apr 11 17:29:34 user nova-compute[71063]: iSNS:
Apr 11 17:29:34 user nova-compute[71063]: No targets found.
Apr 11 17:29:34 user nova-compute[71063]: STATIC:
Apr 11 17:29:34 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b
Apr 11 17:29:34 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:29:34 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:29:34 user nova-compute[71063]: FIRMWARE:
Apr 11 17:29:34 user nova-compute[71063]: No targets found.
Apr 11 17:29:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:29:34 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:29:34 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd716c9-4dd6-47c9-ab6d-e903be6580c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43cea67-5852-4d59-8b27-d7a2ec5040e4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)
Apr 11 17:29:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b (non-flash)
Apr 11 17:29:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80719240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326b754-47c9-4577-8657-1c086ba83559]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b564e6-a2d3-4554-a5dc-9a2adcae4f13]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2626aff-26c5-4fa4-818c-570595708d16]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083e784-7f92-422a-a8fb-79a90dd76a9a]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8633a-6dfd-45c4-a81c-04cd4c2ef7dd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ef850e-886f-46ab-822b-f51669b8d855]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260]
Apr 11 17:29:34 user nova-compute[71063]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b, portal: 172.16.0.220,3260] successful.
Apr 11 17:29:34 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79fb9a22-498c-4c30-bd46-567c0cac048b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a7a12-5559-46e6-9a96-4c7dfb0ff070]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] <== disconnect_volume: return (278ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:29:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.objects.instance [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'flavor' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Starting instance... {{(pid=71063) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71063) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 17:29:35 user nova-compute[71063]: INFO nova.compute.claims [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Claim successful on node user
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Start building networks asynchronously for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Allocating IP information in the background. {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] allocate_for_instance() {{(pid=71063) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 17:29:35 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 17:29:35 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Start building block device mappings for instance. {{(pid=71063) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.policy [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54f53effabdb4b80aec41b67f3bad208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9352d5bd04c5433c8233473a0a5a9cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71063) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Start spawning the instance on the hypervisor. {{(pid=71063) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Creating instance directory {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 17:29:36 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Creating image(s)
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "/opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "/opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "/opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.129s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "e5da97e85888b8e82d5f5a537d23a85d65087054" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.126s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk 1073741824 {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054,backing_fmt=raw /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk 1073741824" returned: 0 in 0.047s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "e5da97e85888b8e82d5f5a537d23a85d65087054" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5da97e85888b8e82d5f5a537d23a85d65087054 --force-share --output=json" returned: 0 in 0.127s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Checking if we can resize image /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk. size=1073741824 {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.virt.disk.api [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Cannot resize image /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk to a smaller size. {{(pid=71063) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'migration_context' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Created local disks {{(pid=71063) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Ensure instance console log exists: /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/console.log {{(pid=71063) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Successfully created port: 363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 17:29:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Successfully updated port: 363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Building network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Instance cache missing network info. {{(pid=71063) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.compute.manager [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing instance network info cache due to event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Instance network_info: |[{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71063) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.neutron [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Start _get_guest_xml network_info=[{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encryption_format': None, 'device_type': 'disk', 'boot_index': 0, 'encrypted': False, 'size': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'image_id': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 17:29:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:29:37 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71063) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T17:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T16:59:20Z,direct_url=<?>,disk_format='qcow2',id=ead60aec-ecbe-42c9-a205-fb6fdd4aef73,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='2defbac8309a4b7e9ad4fcbcd7e1a3fb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T16:59:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flavor limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Image limits 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flavor pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Image pref 0:0:0 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71063) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Got 1 possible topologies {{(pid=71063) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71063) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1485109156',display_name='tempest-SnapshotDataIntegrityTests-server-1485109156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1485109156',id=47,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLQB3hCozlMMIqp8odpehHgtCJL4HcFmbQmLQu5HQlMQXnbcjyZoiXHRa9f7JpNIEhGsNHAJKfdN63Ok9Y6vO6N1/4XwAxq8u/TNPBG1hi9iuATK5K8CEbAJxT4JLAjPg==',key_name='tempest-SnapshotDataIntegrityTests-338437608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9352d5bd04c5433c8233473a0a5a9cfe',ramdisk_id='',reservation_id='r-3vp90bib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-946316985',owner_user_name='tempest-SnapshotDataIntegrityTests-946316985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:29:36Z,user_data=None,user_id='54f53effabdb4b80aec41b67f3bad208',uuid=259f5df3-9c93-4e5e-82cc-5c350632534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71063) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converting VIF {"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'pci_devices' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 17:29:37 user nova-compute[71063]:   <uuid>259f5df3-9c93-4e5e-82cc-5c350632534b</uuid>
Apr 11 17:29:37 user nova-compute[71063]:   <name>instance-0000002f</name>
Apr 11 17:29:37 user nova-compute[71063]:   <memory>131072</memory>
Apr 11 17:29:37 user nova-compute[71063]:   <vcpu>1</vcpu>
Apr 11 17:29:37 user nova-compute[71063]:   <metadata>
Apr 11 17:29:37 user nova-compute[71063]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 17:29:37 user nova-compute[71063]:       <nova:package version="0.0.0"/>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1485109156</nova:name>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:creationTime>2023-04-11 17:29:37</nova:creationTime>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:flavor name="m1.nano">
Apr 11 17:29:37 user nova-compute[71063]:         <nova:memory>128</nova:memory>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:disk>1</nova:disk>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:swap>0</nova:swap>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:vcpus>1</nova:vcpus>
Apr 11 17:29:37 user nova-compute[71063]:       </nova:flavor>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:owner>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:user uuid="54f53effabdb4b80aec41b67f3bad208">tempest-SnapshotDataIntegrityTests-946316985-project-member</nova:user>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:project uuid="9352d5bd04c5433c8233473a0a5a9cfe">tempest-SnapshotDataIntegrityTests-946316985</nova:project>
Apr 11 17:29:37 user nova-compute[71063]:       </nova:owner>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:root type="image" uuid="ead60aec-ecbe-42c9-a205-fb6fdd4aef73"/>
Apr 11 17:29:37 user nova-compute[71063]:       <nova:ports>
Apr 11 17:29:37 user nova-compute[71063]:         <nova:port uuid="363c768e-4cdf-4715-98c4-1bfce1e81e49">
Apr 11 17:29:37 user nova-compute[71063]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 17:29:37 user nova-compute[71063]:         </nova:port>
Apr 11 17:29:37 user nova-compute[71063]:       </nova:ports>
Apr 11 17:29:37 user nova-compute[71063]:     </nova:instance>
Apr 11 17:29:37 user nova-compute[71063]:   </metadata>
Apr 11 17:29:37 user nova-compute[71063]:   <sysinfo type="smbios">
Apr 11 17:29:37 user nova-compute[71063]:     <system>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="product">OpenStack Nova</entry>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="version">0.0.0</entry>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="serial">259f5df3-9c93-4e5e-82cc-5c350632534b</entry>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="uuid">259f5df3-9c93-4e5e-82cc-5c350632534b</entry>
Apr 11 17:29:37 user nova-compute[71063]:       <entry name="family">Virtual Machine</entry>
Apr 11 17:29:37 user nova-compute[71063]:     </system>
Apr 11 17:29:37 user nova-compute[71063]:   </sysinfo>
Apr 11 17:29:37 user nova-compute[71063]:   <os>
Apr 11 17:29:37 user nova-compute[71063]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 17:29:37 user nova-compute[71063]:     <boot dev="hd"/>
Apr 11 17:29:37 user nova-compute[71063]:     <smbios mode="sysinfo"/>
Apr 11 17:29:37 user nova-compute[71063]:   </os>
Apr 11 17:29:37 user nova-compute[71063]:   <features>
Apr 11 17:29:37 user nova-compute[71063]:     <acpi/>
Apr 11 17:29:37 user nova-compute[71063]:     <apic/>
Apr 11 17:29:37 user nova-compute[71063]:     <vmcoreinfo/>
Apr 11 17:29:37 user nova-compute[71063]:   </features>
Apr 11 17:29:37 user nova-compute[71063]:   <clock offset="utc">
Apr 11 17:29:37 user nova-compute[71063]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 17:29:37 user nova-compute[71063]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 17:29:37 user nova-compute[71063]:     <timer name="hpet" present="no"/>
Apr 11 17:29:37 user nova-compute[71063]:   </clock>
Apr 11 17:29:37 user nova-compute[71063]:   <cpu mode="custom" match="exact">
Apr 11 17:29:37 user nova-compute[71063]:     <model>Nehalem</model>
Apr 11 17:29:37 user nova-compute[71063]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 17:29:37 user nova-compute[71063]:   </cpu>
Apr 11 17:29:37 user nova-compute[71063]:   <devices>
Apr 11 17:29:37 user nova-compute[71063]:     <disk type="file" device="disk">
Apr 11 17:29:37 user nova-compute[71063]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 17:29:37 user nova-compute[71063]:       <source file="/opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk"/>
Apr 11 17:29:37 user nova-compute[71063]:       <target dev="vda" bus="virtio"/>
Apr 11 17:29:37 user nova-compute[71063]:     </disk>
Apr 11 17:29:37 user nova-compute[71063]:     <interface type="ethernet">
Apr 11 17:29:37 user nova-compute[71063]:       <mac address="fa:16:3e:1b:85:95"/>
Apr 11 17:29:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:29:37 user nova-compute[71063]:       <mtu size="1442"/>
Apr 11 17:29:37 user nova-compute[71063]:       <target dev="tap363c768e-4c"/>
Apr 11 17:29:37 user nova-compute[71063]:     </interface>
Apr 11 17:29:37 user nova-compute[71063]:     <serial type="pty">
Apr 11 17:29:37 user nova-compute[71063]:       <log file="/opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/console.log" append="off"/>
Apr 11 17:29:37 user nova-compute[71063]:     </serial>
Apr 11 17:29:37 user nova-compute[71063]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 17:29:37 user nova-compute[71063]:     <video>
Apr 11 17:29:37 user nova-compute[71063]:       <model type="virtio"/>
Apr 11 17:29:37 user nova-compute[71063]:     </video>
Apr 11 17:29:37 user nova-compute[71063]:     <rng model="virtio">
Apr 11 17:29:37 user nova-compute[71063]:       <backend model="random">/dev/urandom</backend>
Apr 11 17:29:37 user nova-compute[71063]:     </rng>
Apr 11 17:29:37 user nova-compute[71063]:     <controller type="usb" index="0" model="none"/>
Apr 11 17:29:37 user nova-compute[71063]:     <memballoon model="virtio">
Apr 11 17:29:37 user nova-compute[71063]:       <stats period="10"/>
Apr 11 17:29:37 user nova-compute[71063]:     </memballoon>
Apr 11 17:29:37 user nova-compute[71063]:   </devices>
Apr 11 17:29:37 user nova-compute[71063]: </domain>
Apr 11 17:29:37 user nova-compute[71063]:  {{(pid=71063) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1485109156',display_name='tempest-SnapshotDataIntegrityTests-server-1485109156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1485109156',id=47,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLQB3hCozlMMIqp8odpehHgtCJL4HcFmbQmLQu5HQlMQXnbcjyZoiXHRa9f7JpNIEhGsNHAJKfdN63Ok9Y6vO6N1/4XwAxq8u/TNPBG1hi9iuATK5K8CEbAJxT4JLAjPg==',key_name='tempest-SnapshotDataIntegrityTests-338437608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9352d5bd04c5433c8233473a0a5a9cfe',ramdisk_id='',reservation_id='r-3vp90bib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-946316985',owner_user_name='tempest-SnapshotDataIntegrityTests-946316985-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T17:29:36Z,user_data=None,user_id='54f53effabdb4b80aec41b67f3bad208',uuid=259f5df3-9c93-4e5e-82cc-5c350632534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converting VIF {"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG os_vif [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c') {{(pid=71063) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap363c768e-4c, may_exist=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap363c768e-4c, col_values=(('external_ids', {'iface-id': '363c768e-4cdf-4715-98c4-1bfce1e81e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:85:95', 'vm-uuid': '259f5df3-9c93-4e5e-82cc-5c350632534b'}),)) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:37 user nova-compute[71063]: INFO os_vif [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c')
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:29:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No VIF found with MAC fa:16:3e:1b:85:95, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:29:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated VIF entry in instance network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:29:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:29:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG nova.compute.manager [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] No waiting events found dispatching network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:29:39 user nova-compute[71063]: WARNING nova.compute.manager [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received unexpected event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance with vm_state building and task_state spawning.
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234181.2028446, 259f5df3-9c93-4e5e-82cc-5c350632534b => Resumed> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] VM Resumed (Lifecycle Event)
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Instance event wait completed in 0 seconds for  {{(pid=71063) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Guest created on hypervisor {{(pid=71063) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Instance spawned successfully.
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_cdrom_bus of ide {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_disk_bus of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_input_bus of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_pointer_model of None {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_video_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Found default for hw_vif_model of virtio {{(pid=71063) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.virt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Emitting event <LifecycleEvent: 1681234181.2041, 259f5df3-9c93-4e5e-82cc-5c350632534b => Started> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] VM Started (Lifecycle Event)
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71063) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:29:41 user nova-compute[71063]: INFO nova.compute.manager [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Took 5.76 seconds to build instance.
Apr 11 17:29:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.857s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:41 user nova-compute[71063]: DEBUG nova.compute.manager [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] No waiting events found dispatching network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:29:41 user nova-compute[71063]: WARNING nova.compute.manager [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received unexpected event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance with vm_state active and task_state None.
Apr 11 17:29:42 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:47 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:51 user nova-compute[71063]: INFO nova.compute.manager [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Terminating instance
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.compute.manager [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-unplugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] No waiting events found dispatching network-vif-unplugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.compute.manager [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-unplugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Instance destroyed successfully.
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.objects.instance [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lazy-loading 'resources' on Instance uuid 8bee1911-3859-4292-8bc5-4572963aa007 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1316453602',display_name='tempest-VolumesNegativeTest-instance-1316453602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1316453602',id=46,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f8aed1a07fb4244ad9ec8c8d9816a27',ramdisk_id='',reservation_id='r-0ad8gqy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2079915658',owner_user_name='tempest-VolumesNegativeTest-2079915658-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:28:08Z,user_data=None,user_id='cde9c28bb4f84dc7bb865446203e54eb',uuid=8bee1911-3859-4292-8bc5-4572963aa007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converting VIF {"id": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "address": "fa:16:3e:ed:e0:76", "network": {"id": "7ad74db4-2349-4724-a8bd-6ade0da93b6b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.97", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2defbac8309a4b7e9ad4fcbcd7e1a3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc32a4b0d-6d", "ovs_interfaceid": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG os_vif [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc32a4b0d-6d, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:29:51 user nova-compute[71063]: INFO os_vif [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e0:76,bridge_name='br-int',has_traffic_filtering=True,id=c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1,network=Network(7ad74db4-2349-4724-a8bd-6ade0da93b6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc32a4b0d-6d')
Apr 11 17:29:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Deleting instance files /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007_del
Apr 11 17:29:51 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Deletion of /opt/stack/data/nova/instances/8bee1911-3859-4292-8bc5-4572963aa007_del complete
Apr 11 17:29:51 user nova-compute[71063]: INFO nova.compute.manager [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 11 17:29:51 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:29:51 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:29:52 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:29:52 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Took 0.48 seconds to deallocate network for instance.
Apr 11 17:29:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:52 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:29:52 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:29:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:52 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Deleted allocations for instance 8bee1911-3859-4292-8bc5-4572963aa007
Apr 11 17:29:52 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "8bee1911-3859-4292-8bc5-4572963aa007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.519s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Acquiring lock "8bee1911-3859-4292-8bc5-4572963aa007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:29:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:29:53 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Lock "8bee1911-3859-4292-8bc5-4572963aa007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:29:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] No waiting events found dispatching network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:29:53 user nova-compute[71063]: WARNING nova.compute.manager [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received unexpected event network-vif-plugged-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance with vm_state deleted and task_state None.
Apr 11 17:29:53 user nova-compute[71063]: DEBUG nova.compute.manager [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Received event network-vif-deleted-c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:29:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:56 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:29:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:01 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:06 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234191.6793165, 8bee1911-3859-4292-8bc5-4572963aa007 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:30:06 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] VM Stopped (Lifecycle Event)
Apr 11 17:30:06 user nova-compute[71063]: DEBUG nova.compute.manager [None req-8db91896-a6b5-4eb5-a1c8-7daeba767acc None None] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:30:06 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:11 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:12 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:30:16 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:30:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:21 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:23 user nova-compute[71063]: INFO nova.compute.manager [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Terminating instance
Apr 11 17:30:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:23 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-unplugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] No waiting events found dispatching network-vif-unplugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.compute.manager [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-unplugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Instance destroyed successfully.
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.objects.instance [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'resources' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:27:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832781409',display_name='tempest-AttachVolumeNegativeTest-server-1832781409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832781409',id=45,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjg6y5c4bWzxie1RNFs/ruXDTwr9qyR6V7QApxc9dx7meAMZb0t2pHrv+9TjRRauBB9uzs9qyo+QKd+sjmfFNUwSjqtKGcMeN9je+lKciRvzvtoxCGx3G5zz+z8zj+Lag==',key_name='tempest-keypair-50229463',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:27:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23c663a759724bbda32f189ceedf6675',ramdisk_id='',reservation_id='r-g0eltgr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1862265490',owner_user_name='tempest-AttachVolumeNegativeTest-1862265490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff27d08254f74491aba3386c9b901300',uuid=4d149c96-1eca-4e4c-8165-e56fcfb1f730,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converting VIF {"id": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "address": "fa:16:3e:0c:a3:d5", "network": {"id": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1116153070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23c663a759724bbda32f189ceedf6675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b3a5d7c-36", "ovs_interfaceid": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG os_vif [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b3a5d7c-36, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:30:24 user nova-compute[71063]: INFO os_vif [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:a3:d5,bridge_name='br-int',has_traffic_filtering=True,id=2b3a5d7c-36dd-4752-81ff-b52dd20899e1,network=Network(f6d30218-0af4-4ce4-bb7e-990a43a37ec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b3a5d7c-36')
Apr 11 17:30:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Deleting instance files /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730_del
Apr 11 17:30:24 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Deletion of /opt/stack/data/nova/instances/4d149c96-1eca-4e4c-8165-e56fcfb1f730_del complete
Apr 11 17:30:24 user nova-compute[71063]: INFO nova.compute.manager [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 17:30:24 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:30:24 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:30:25 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Took 1.07 seconds to deallocate network for instance.
Apr 11 17:30:25 user nova-compute[71063]: DEBUG nova.compute.manager [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-deleted-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:30:25 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:26 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Deleted allocations for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730
Apr 11 17:30:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.254s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:30:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Acquiring lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:26 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Lock "4d149c96-1eca-4e4c-8165-e56fcfb1f730-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:26 user nova-compute[71063]: DEBUG nova.compute.manager [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] No waiting events found dispatching network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:30:26 user nova-compute[71063]: WARNING nova.compute.manager [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Received unexpected event network-vif-plugged-2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance with vm_state deleted and task_state None.
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:30:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:30:27 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:30:27 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=26.275272369384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:30:27 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:30:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:30:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:30:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:39 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234224.5985253, 4d149c96-1eca-4e4c-8165-e56fcfb1f730 => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:30:39 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] VM Stopped (Lifecycle Event)
Apr 11 17:30:39 user nova-compute[71063]: DEBUG nova.compute.manager [None req-91bfed36-a7ce-4402-95af-bcfbea04cc91 None None] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:30:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:30:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:30:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:31:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:31:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:31:14 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:31:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:31:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:31:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG nova.compute.manager [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing instance network info cache due to event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG nova.network.neutron [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:31:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:31:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:31:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=26.26485824584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:31:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:31:29 user nova-compute[71063]: INFO nova.compute.manager [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attaching volume 6b0196b8-5f51-481e-b825-8b35763b7e73 to /dev/vdb
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[42246112-c127-47a4-94a4-e74c3e5add26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95c4a9-2a9b-4fd2-b49f-edcb0c373d2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8065fc11-2db1-4364-a0eb-3d1e1b83d47a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d701a20-41ca-4ec5-a867-380fe5298a25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated VIF entry in instance network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.network.neutron [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:31:29 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:31:29 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba02167-1cf6-4371-b045-27316eba2a02]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG os_brick.utils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating existing volume attachment record: 180bdbef-9cdc-4b5a-9588-b1eb5bde2148 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:31:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:31 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOMcoCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:31:33 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:31:33 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:31:33 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97d80a8-aaaf-49f1-b773-edd830cec4f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:31:33 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cb1742-e29c-46b5-a8da-f8f0ce2c3b3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73] added
Apr 11 17:31:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[28282724-0b1a-4f37-aabf-f28d7c1eee51]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad9774e-cbd9-44bf-a1f7-d9a530236ef0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOMcoCjV {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WOMcoCjV" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7374c848-4441-4a01-b121-1d6cc0a504fc]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WOMcoCjV'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1ffbb-ea0c-4e1d-9b01-7e45356c05d0]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef016bf-3cb2-444f-b26b-b9d3338a3130]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:31:33 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:31:33 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:31:33 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:31:33 user nova-compute[71063]: 
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab689929-a94a-4a23-b1b8-81937f70aad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260]
Apr 11 17:31:33 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260] successful.
Apr 11 17:31:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[472443c9-38ce-4e9e-9f24-6e16e1e0a449]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3127a6-9752-4090-8e91-eb7e910a12a3]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)
Apr 11 17:31:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)
Apr 11 17:31:33 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c46f8-dead-49ba-a764-302f9ee3519a]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:31:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOMcoCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23266306638323364', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266306638323364', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG nova.objects.instance [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:31:34 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:31:34 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:31:34 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:31:34 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:31:34 user nova-compute[71063]:   <serial>6b0196b8-5f51-481e-b825-8b35763b7e73</serial>
Apr 11 17:31:34 user nova-compute[71063]: </disk>
Apr 11 17:31:34 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:31:35 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:31:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:31:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:31:35 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No VIF found with MAC fa:16:3e:1b:85:95, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:31:35 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.052s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:31:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:31:41 user nova-compute[71063]: INFO nova.compute.manager [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Detaching volume 6b0196b8-5f51-481e-b825-8b35763b7e73
Apr 11 17:31:41 user nova-compute[71063]: INFO nova.virt.block_device [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attempting to driver detach volume 6b0196b8-5f51-481e-b825-8b35763b7e73 from mountpoint /dev/vdb
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Attempting to detach device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:31:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:31:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:31:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:31:41 user nova-compute[71063]:   <serial>6b0196b8-5f51-481e-b825-8b35763b7e73</serial>
Apr 11 17:31:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:31:41 user nova-compute[71063]: </disk>
Apr 11 17:31:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:31:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config.
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:31:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:31:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:31:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:31:41 user nova-compute[71063]:   <serial>6b0196b8-5f51-481e-b825-8b35763b7e73</serial>
Apr 11 17:31:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:31:41 user nova-compute[71063]: </disk>
Apr 11 17:31:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234301.6104822, 259f5df3-9c93-4e5e-82cc-5c350632534b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:31:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config.
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WOMcoCjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:31:41 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae234861-8b2b-41d0-86b5-e6c061736113]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:31:41 user nova-compute[71063]: No targets found.
Apr 11 17:31:41 user nova-compute[71063]: iSNS:
Apr 11 17:31:41 user nova-compute[71063]: No targets found.
Apr 11 17:31:41 user nova-compute[71063]: STATIC:
Apr 11 17:31:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73
Apr 11 17:31:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:31:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:31:41 user nova-compute[71063]: FIRMWARE:
Apr 11 17:31:41 user nova-compute[71063]: No targets found.
Apr 11 17:31:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:31:41 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:31:41 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351921b-3aa2-45e7-a6d7-c81765c8693e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf5f979-0b84-45be-9d97-a5398724981a]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)
Apr 11 17:31:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 (non-flash)
Apr 11 17:31:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbe80550040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[824b945b-f13f-449b-8cb5-2d6a69322289]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d392232-a68d-4df8-93e8-c1675525404d]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ccc51b-4d1c-4ec0-a0a5-2efff14f13a4]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d124e29b-f8bb-4c9b-a859-d2681adb29d6]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba275e9-8aec-4dad-90c1-01b4707bc101]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1589b1a-afdb-49a7-9ca7-b32a847d48c8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260]
Apr 11 17:31:41 user nova-compute[71063]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73, portal: 172.16.0.220,3260] successful.
Apr 11 17:31:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b0196b8-5f51-481e-b825-8b35763b7e73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[72729334-1421-40c0-9e1d-9b83c050f8a3]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== disconnect_volume: return (291ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:31:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:31:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:31:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:31:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:31:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:32:15 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:32:16 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:32:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:32:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:32:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:32:28 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:32:28 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=26.263751983642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:32:28 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:32:29 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:32:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:32:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:32:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:32:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:32:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:32:34 user nova-compute[71063]: INFO nova.compute.manager [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attaching volume 59f26f1b-e186-403f-8c6e-32b608933595 to /dev/vdb
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.utils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a93deb-f0e9-4e84-bbae-4e3c593f8890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c9a952-3f9d-4f34-936d-803a60ec4ea2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[319127a2-2be7-43b6-9b84-7b50e475a521]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e832d-137c-43d8-8032-ba9fa7cbc251]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:32:34 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:32:34 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63bba60-3d1c-44ba-8efd-fa20b995c854]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG os_brick.utils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating existing volume attachment record: 485a3cd6-9778-480f-80ef-2794d178545f {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRJzsXcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:32:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:32:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:32:38 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38cf7b6-9551-4647-8bff-71c759b26571]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:32:38 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6bf98-cc15-442b-8b9e-8ab3e6993e54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595] added
Apr 11 17:32:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccfe4df-eab7-429d-aa22-f8c614497190]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3d61b1-8904-4a01-aed1-41841fee3e9a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRJzsXcU {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QRJzsXcU" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[606578b1-0218-4d1b-862f-422004d5a71f]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QRJzsXcU'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cab4aa-63c4-4ae5-a544-d5cfd5bb4e13]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880b7b3-3bba-4fe0-b151-d1789c12baf2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:32:38 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:32:38 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:32:38 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:32:38 user nova-compute[71063]: 
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcddc7f6-4e1f-485b-a1f0-2435f0b43b93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260]
Apr 11 17:32:38 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260] successful.
Apr 11 17:32:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf1b393-6573-4e4b-afbe-85e135b1b28a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f1201-7f07-4ec4-8b31-dadf79e56d9e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)
Apr 11 17:32:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)
Apr 11 17:32:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d739d12-35fd-4102-ba2d-d19b2cf30037]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:32:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRJzsXcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26161646261396466', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161646261396466', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:32:39 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:32:39 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:32:39 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:32:39 user nova-compute[71063]:   <serial>59f26f1b-e186-403f-8c6e-32b608933595</serial>
Apr 11 17:32:39 user nova-compute[71063]: </disk>
Apr 11 17:32:39 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:32:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No VIF found with MAC fa:16:3e:1b:85:95, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:32:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.076s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:32:41 user nova-compute[71063]: INFO nova.compute.manager [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Detaching volume 59f26f1b-e186-403f-8c6e-32b608933595
Apr 11 17:32:41 user nova-compute[71063]: INFO nova.virt.block_device [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attempting to driver detach volume 59f26f1b-e186-403f-8c6e-32b608933595 from mountpoint /dev/vdb
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Attempting to detach device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:32:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:32:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:32:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:32:41 user nova-compute[71063]:   <serial>59f26f1b-e186-403f-8c6e-32b608933595</serial>
Apr 11 17:32:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:32:41 user nova-compute[71063]: </disk>
Apr 11 17:32:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:32:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config.
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:32:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:32:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:32:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:32:41 user nova-compute[71063]:   <serial>59f26f1b-e186-403f-8c6e-32b608933595</serial>
Apr 11 17:32:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:32:41 user nova-compute[71063]: </disk>
Apr 11 17:32:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234361.5268972, 259f5df3-9c93-4e5e-82cc-5c350632534b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:32:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config.
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QRJzsXcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:32:41 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b02875-4a3a-42ac-ae3a-f6f47355e5f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:32:41 user nova-compute[71063]: No targets found.
Apr 11 17:32:41 user nova-compute[71063]: iSNS:
Apr 11 17:32:41 user nova-compute[71063]: No targets found.
Apr 11 17:32:41 user nova-compute[71063]: STATIC:
Apr 11 17:32:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595
Apr 11 17:32:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:32:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:32:41 user nova-compute[71063]: FIRMWARE:
Apr 11 17:32:41 user nova-compute[71063]: No targets found.
Apr 11 17:32:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:32:41 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:32:41 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f459b9-4683-4caa-abdc-6f7b947c5466]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[227108ea-fb35-4b0a-9988-c3170d8c3186]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)
Apr 11 17:32:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 (non-flash)
Apr 11 17:32:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38e532-843a-4525-ba30-3507cbcabf77]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d13258-3c44-4f00-8f00-cab24499b110]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2141059d-8ddb-4e32-bdd5-39525e7128cf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[da278b20-2d71-4be4-8cf3-d6988393b0e2]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d522b6-9929-4ebb-8e3c-533a6bc9129a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[009329c1-cece-4908-bc9a-0ac3c7f0a036]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260]
Apr 11 17:32:41 user nova-compute[71063]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595, portal: 172.16.0.220,3260] successful.
Apr 11 17:32:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f26f1b-e186-403f-8c6e-32b608933595 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2c4c1-9283-452b-aea8-36b3a299df1a]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== disconnect_volume: return (276ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:32:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:32:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:32:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:32:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:49 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:32:54 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:32:59 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:04 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:14 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:16 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:33:17 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:33:19 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:22 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:23 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:24 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:33:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=26.262680053710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:33:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG nova.objects.instance [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:33:32 user nova-compute[71063]: INFO nova.compute.manager [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attaching volume 1cfe301b-d25c-41bc-8221-8fa2d84cff7f to /dev/vdb
Apr 11 17:33:32 user nova-compute[71063]: DEBUG os_brick.utils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[83453ce0-6abe-40d1-8365-c3bf66cacf71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:32 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[58edc90d-53e8-4b90-ac42-c29f0c46efba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[50554168-72e9-4e4e-b136-07093534ea1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4716d6-bf70-4eef-93a3-cd6f51ef2ed6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:33:33 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:33:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[338018f7-83bb-472d-a50f-bd5f0c8d7524]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG os_brick.utils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:33:33 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating existing volume attachment record: f732dae4-6cdd-471d-841a-bd993b70b4a5 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:33:34 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvceFPmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:33:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:33:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:33:37 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af14e1-0499-4aca-b24d-2e951396d233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:33:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[08862b93-7106-4971-8c8d-08e17b90884e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f] added
Apr 11 17:33:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07f920-3644-4683-a2a2-37bf4261b4c1]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa05e04-16a8-4f4c-b7b0-a975aaf060a6]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kvceFPmK {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kvceFPmK" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3791b-6468-4160-ad6b-78108aab6ebd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kvceFPmK'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.094s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d59cf35-a698-42af-a097-964d92f5e04b]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a83b038-7f30-4e8d-87ae-2262af65218c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:33:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:33:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:33:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:33:37 user nova-compute[71063]: 
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1de053-75b5-4fc1-a00c-7cecb5ce0381]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260]
Apr 11 17:33:37 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260] successful.
Apr 11 17:33:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be6e43d-71dc-4461-91ea-f02e1a6136ae]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[26607949-ee76-48ec-be28-f6c410be8f96]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)
Apr 11 17:33:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)
Apr 11 17:33:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a22eb5-6997-4ba2-837b-6fa82ac9913e]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:33:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvceFPmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23035373739386534', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035373739386534', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG nova.objects.instance [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:33:38 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:33:38 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:33:38 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:33:38 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:33:38 user nova-compute[71063]:   <serial>1cfe301b-d25c-41bc-8221-8fa2d84cff7f</serial>
Apr 11 17:33:38 user nova-compute[71063]: </disk>
Apr 11 17:33:38 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:33:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:33:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:33:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No VIF found with MAC fa:16:3e:1b:85:95, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:33:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.646s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:33:41 user nova-compute[71063]: INFO nova.compute.manager [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Detaching volume 1cfe301b-d25c-41bc-8221-8fa2d84cff7f
Apr 11 17:33:41 user nova-compute[71063]: INFO nova.virt.block_device [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attempting to driver detach volume 1cfe301b-d25c-41bc-8221-8fa2d84cff7f from mountpoint /dev/vdb
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Attempting to detach device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:33:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:33:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:33:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:33:41 user nova-compute[71063]:   <serial>1cfe301b-d25c-41bc-8221-8fa2d84cff7f</serial>
Apr 11 17:33:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:33:41 user nova-compute[71063]: </disk>
Apr 11 17:33:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:33:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config.
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:33:41 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:33:41 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:33:41 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:33:41 user nova-compute[71063]:   <serial>1cfe301b-d25c-41bc-8221-8fa2d84cff7f</serial>
Apr 11 17:33:41 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:33:41 user nova-compute[71063]: </disk>
Apr 11 17:33:41 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234421.726752, 259f5df3-9c93-4e5e-82cc-5c350632534b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:33:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config.
Apr 11 17:33:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kvceFPmK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:33:41 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e8f1d-aff6-46ce-9464-b388031bd32e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:33:41 user nova-compute[71063]: No targets found.
Apr 11 17:33:41 user nova-compute[71063]: iSNS:
Apr 11 17:33:41 user nova-compute[71063]: No targets found.
Apr 11 17:33:41 user nova-compute[71063]: STATIC:
Apr 11 17:33:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f
Apr 11 17:33:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:33:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:33:41 user nova-compute[71063]: FIRMWARE:
Apr 11 17:33:41 user nova-compute[71063]: No targets found.
Apr 11 17:33:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:33:41 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:33:41 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8630312-3913-4c52-92e0-fa034ee7e6fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[246eae3c-77cf-4ff5-8f56-936274de8487]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)
Apr 11 17:33:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f (non-flash)
Apr 11 17:33:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbeb40f0af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82036a7-4a03-4c6f-b95e-fe185bf7d787]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e8d68-683b-48ca-a969-54894f9ff319]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8abc5c1-ff12-4047-948a-313bfbc50602]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ac7d6-e78c-4a2e-99c3-447288126ede]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb3d21-58cd-4991-a30c-059722e57f79]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac4e48-be09-4e76-903e-88240584fa00]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260]
Apr 11 17:33:41 user nova-compute[71063]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f, portal: 172.16.0.220,3260] successful.
Apr 11 17:33:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfe301b-d25c-41bc-8221-8fa2d84cff7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9d017-1d54-418a-8629-5f312269c8f8]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== disconnect_volume: return (266ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:33:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.618s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:33:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:33:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:33:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:09 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:34:18 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:34:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:34:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:34:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:34:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:34:21 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:21 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71063) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 17:34:23 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:25 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:34:27 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:34:29 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:34:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=26.261722564697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:34:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing inventories for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating ProviderTree inventory for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Updating inventory in ProviderTree for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing aggregate associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, aggregates: None {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Refreshing trait associations for resource provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd, traits: COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NODE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING {{(pid=71063) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:34:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:34:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:32 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Cleaning up deleted instances {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 17:34:32 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] There are 0 instances to clean {{(pid=71063) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:34:33 user nova-compute[71063]: INFO nova.compute.manager [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attaching volume 250c8678-d72d-49c8-9830-3533768276fc to /dev/vdb
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.utils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5141d39-adc0-4d9b-9bb2-2e910632a405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:11e1c9ffa25\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[503a9ec4-6756-45b3-8737-440b23521851]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[65923492-09bf-4f99-b803-7a8f8f26bdba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c5532-1aff-4947-b64d-01525abfd7f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Running cmd (subprocess): nvme version {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 'nvme version' failed. Not Retrying. {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] nvme not present on system {{(pid=71063) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 17:34:33 user nova-compute[71063]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 17:34:33 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4771663-d4b2-4c33-a423-26b2773dc836]: (4, '') {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71063) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.lightos [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] LIGHTOS: no hostnqn found. {{(pid=71063) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG os_brick.utils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:11e1c9ffa25', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:34:33 user nova-compute[71063]: DEBUG nova.virt.block_device [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating existing volume attachment record: 3166cf71-6c59-4819-aeea-942a849459c2 {{(pid=71063) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 17:34:34 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:34 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Calling os-brick to attach iSCSI Volume {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGUqjgbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:34:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:34:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:34:37 user nova-compute[71063]: INFO os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[137601f4-bc96-4a45-813b-c38e64cea33f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 17:34:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --interface default --op new {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5cb47f-06b6-47d5-9d15-a7e126da6136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc] added\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc] added
Apr 11 17:34:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f7c12d-d678-47f5-93fd-48d3d30b84cf]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d10022-6910-4ccc-bbe7-ecf4a0b54888]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGUqjgbM {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DGUqjgbM" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c1bad-45fb-43a4-acb3-58972ed8dc5c]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DGUqjgbM'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[5604df18-1dd0-410a-bc0c-e4c1fa663982]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28d720-167b-4a27-9ce2-20704ae0e313]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:34:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 17:34:37 user nova-compute[71063]:  {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:34:37 user nova-compute[71063]: WARNING os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 17:34:37 user nova-compute[71063]: 
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --login {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c51f1d-8d7b-48bb-a969-fa34b71dc4d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260]
Apr 11 17:34:37 user nova-compute[71063]: Login to [iface: default, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260] successful.
Apr 11 17:34:37 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f6f40-af8b-4a77-981c-6245e4e8a80d]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:37 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23fee8f-2091-4e1e-9ce4-74bc27d541c3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)
Apr 11 17:34:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)
Apr 11 17:34:38 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to 172.16.0.220:3260 {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71063) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71063) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c45f10-a801-40a5-9233-810eb5278d8f]: (4, ('- - 0', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71063) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 17:34:38 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGUqjgbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71063) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26161613862316139', 'path': '/dev/sdb'} {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161613862316139', 'path': '/dev/sdb'} {{(pid=71063) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.objects.instance [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 17:34:39 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:34:39 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:34:39 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:34:39 user nova-compute[71063]:   <serial>250c8678-d72d-49c8-9830-3533768276fc</serial>
Apr 11 17:34:39 user nova-compute[71063]: </disk>
Apr 11 17:34:39 user nova-compute[71063]:  {{(pid=71063) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vda, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71063) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] No VIF found with MAC fa:16:3e:1b:85:95, not building metadata {{(pid=71063) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.128s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:34:40 user nova-compute[71063]: INFO nova.compute.manager [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Detaching volume 250c8678-d72d-49c8-9830-3533768276fc
Apr 11 17:34:40 user nova-compute[71063]: INFO nova.virt.block_device [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Attempting to driver detach volume 250c8678-d72d-49c8-9830-3533768276fc from mountpoint /dev/vdb
Apr 11 17:34:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Attempting to detach device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config. {{(pid=71063) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:34:40 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:34:40 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:34:40 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:34:40 user nova-compute[71063]:   <serial>250c8678-d72d-49c8-9830-3533768276fc</serial>
Apr 11 17:34:40 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:34:40 user nova-compute[71063]: </disk>
Apr 11 17:34:40 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:34:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the persistent domain config.
Apr 11 17:34:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config. {{(pid=71063) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 17:34:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.guest [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 17:34:40 user nova-compute[71063]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 17:34:40 user nova-compute[71063]:   <source dev="/dev/sdb"/>
Apr 11 17:34:40 user nova-compute[71063]:   <target dev="vdb" bus="virtio"/>
Apr 11 17:34:40 user nova-compute[71063]:   <serial>250c8678-d72d-49c8-9830-3533768276fc</serial>
Apr 11 17:34:40 user nova-compute[71063]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 17:34:40 user nova-compute[71063]: </disk>
Apr 11 17:34:40 user nova-compute[71063]:  {{(pid=71063) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-4236b02c-1e24-40cb-abe1-a803c5a02579 None None] Received event <DeviceRemovedEvent: 1681234481.1736999, 259f5df3-9c93-4e5e-82cc-5c350632534b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71063) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.driver [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 17:34:41 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully detached device vdb from instance 259f5df3-9c93-4e5e-82cc-5c350632534b from the live domain config.
Apr 11 17:34:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] calling os-brick to detach iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fbe806f3250>, {'target_iqn': 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DGUqjgbM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 17:34:41 user nova-compute[71063]: WARNING os_brick.initiator.connectors.base [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[082fb338-ddb3-44d3-b52c-0f71568d0a19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 17:34:41 user nova-compute[71063]: No targets found.
Apr 11 17:34:41 user nova-compute[71063]: iSNS:
Apr 11 17:34:41 user nova-compute[71063]: No targets found.
Apr 11 17:34:41 user nova-compute[71063]: STATIC:
Apr 11 17:34:41 user nova-compute[71063]: Target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc
Apr 11 17:34:41 user nova-compute[71063]:         Portal: 172.16.0.220:3260,-1
Apr 11 17:34:41 user nova-compute[71063]:                 Iface Name: default
Apr 11 17:34:41 user nova-compute[71063]: FIRMWARE:
Apr 11 17:34:41 user nova-compute[71063]: No targets found.
Apr 11 17:34:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 17:34:41 user nova-compute[71063]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 17:34:41 user nova-compute[71063]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71063) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc', 0)] {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb9277-8b1e-462b-8eba-f1282500ed4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[e659710c-d574-4770-a4de-c3e4d47e083c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)
Apr 11 17:34:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc (non-flash)
Apr 11 17:34:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fbea476c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc'): ({'sdb'}, set())}) {{(pid=71063) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Removing single pathed devices sdb {{(pid=71063) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d137713-5e28-4bf6-8427-ea715b6cae31]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49425b2-7018-44d6-b451-8dacdba36fd6]: (4, ('ok\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flushing IO for device /dev/sdb {{(pid=71063) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ee4df-0b96-4f08-be81-a1ea294d3baa]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71063) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e461ef9-70d4-4042-b165-3fe1c683d890]: (4, ('1', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.linuxscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] SCSI volumes sdb have been removed. {{(pid=71063) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc')] {{(pid=71063) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d4a64f-2948-4744-98e2-638d8451e801]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --logout {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9bf25-f04e-4fb1-b5f0-19f1f9ad5aa0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260]
Apr 11 17:34:41 user nova-compute[71063]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc, portal: 172.16.0.220,3260] successful.
Apr 11 17:34:41 user nova-compute[71063]:  stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op delete {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:250c8678-d72d-49c8-9830-3533768276fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81529) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG oslo.privsep.daemon [-] privsep: reply[63740181-80e0-4e9d-ba0e-34bd57d10acd]: (4, ('', '')) {{(pid=81529) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71063) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.base [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG os_brick.initiator.connectors.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] <== disconnect_volume: return (286ms) None {{(pid=71063) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 17:34:41 user nova-compute[71063]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Disconnected iSCSI Volume {{(pid=71063) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 17:34:42 user nova-compute[71063]: DEBUG nova.objects.instance [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'flavor' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:34:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.639s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:34:44 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:34:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:34:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:18 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Forcefully refreshing network info cache for instance {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.objects.instance [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lazy-loading 'info_cache' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.network.neutron [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:35:19 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated the network info_cache for instance {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 17:35:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:25 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:35:27 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 17:35:29 user nova-compute[71063]: DEBUG oslo_concurrency.processutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71063) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 17:35:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:35:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=26.26076889038086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Instance 259f5df3-9c93-4e5e-82cc-5c350632534b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71063) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:35:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:34 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:34 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG nova.compute.manager [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing instance network info cache due to event network-changed-363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Acquiring lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Acquired lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 17:35:38 user nova-compute[71063]: DEBUG nova.network.neutron [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Refreshing network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 17:35:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updated VIF entry in instance network info cache for port 363c768e-4cdf-4715-98c4-1bfce1e81e49. {{(pid=71063) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 17:35:39 user nova-compute[71063]: DEBUG nova.network.neutron [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [{"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:35:39 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Releasing lock "refresh_cache-259f5df3-9c93-4e5e-82cc-5c350632534b" {{(pid=71063) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:40 user nova-compute[71063]: INFO nova.compute.manager [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Terminating instance
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.compute.manager [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Start destroying the instance on the hypervisor. {{(pid=71063) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-unplugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] No waiting events found dispatching network-vif-unplugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.compute.manager [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-unplugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance with task_state deleting. {{(pid=71063) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 17:35:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Instance destroyed successfully.
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.objects.instance [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'resources' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=71063) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.virt.libvirt.vif [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T17:29:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1485109156',display_name='tempest-SnapshotDataIntegrityTests-server-1485109156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1485109156',id=47,image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLQB3hCozlMMIqp8odpehHgtCJL4HcFmbQmLQu5HQlMQXnbcjyZoiXHRa9f7JpNIEhGsNHAJKfdN63Ok9Y6vO6N1/4XwAxq8u/TNPBG1hi9iuATK5K8CEbAJxT4JLAjPg==',key_name='tempest-SnapshotDataIntegrityTests-338437608',keypairs=<?>,launch_index=0,launched_at=2023-04-11T17:29:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9352d5bd04c5433c8233473a0a5a9cfe',ramdisk_id='',reservation_id='r-3vp90bib',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-946316985',owner_user_name='tempest-SnapshotDataIntegrityTests-946316985-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T17:29:41Z,user_data=None,user_id='54f53effabdb4b80aec41b67f3bad208',uuid=259f5df3-9c93-4e5e-82cc-5c350632534b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converting VIF {"id": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "address": "fa:16:3e:1b:85:95", "network": {"id": "231e0b88-2a84-41ce-ab60-81d7abe6161b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-828847222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9352d5bd04c5433c8233473a0a5a9cfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap363c768e-4c", "ovs_interfaceid": "363c768e-4cdf-4715-98c4-1bfce1e81e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.network.os_vif_util [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c') {{(pid=71063) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG os_vif [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c') {{(pid=71063) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap363c768e-4c, bridge=br-int, if_exists=True) {{(pid=71063) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:40 user nova-compute[71063]: INFO os_vif [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:85:95,bridge_name='br-int',has_traffic_filtering=True,id=363c768e-4cdf-4715-98c4-1bfce1e81e49,network=Network(231e0b88-2a84-41ce-ab60-81d7abe6161b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap363c768e-4c')
Apr 11 17:35:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Deleting instance files /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b_del
Apr 11 17:35:40 user nova-compute[71063]: INFO nova.virt.libvirt.driver [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Deletion of /opt/stack/data/nova/instances/259f5df3-9c93-4e5e-82cc-5c350632534b_del complete
Apr 11 17:35:40 user nova-compute[71063]: INFO nova.compute.manager [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 17:35:40 user nova-compute[71063]: DEBUG oslo.service.loopingcall [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71063) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.compute.manager [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Deallocating network for instance {{(pid=71063) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 17:35:40 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] deallocate_for_instance() {{(pid=71063) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 17:35:41 user nova-compute[71063]: DEBUG nova.network.neutron [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Updating instance_info_cache with network_info: [] {{(pid=71063) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 17:35:41 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Took 0.50 seconds to deallocate network for instance.
Apr 11 17:35:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:41 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:35:41 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:35:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:41 user nova-compute[71063]: INFO nova.scheduler.client.report [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Deleted allocations for instance 259f5df3-9c93-4e5e-82cc-5c350632534b
Apr 11 17:35:41 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:35:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Acquiring lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:35:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:35:42 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Lock "259f5df3-9c93-4e5e-82cc-5c350632534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:35:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] No waiting events found dispatching network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 17:35:42 user nova-compute[71063]: WARNING nova.compute.manager [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received unexpected event network-vif-plugged-363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance with vm_state deleted and task_state None.
Apr 11 17:35:42 user nova-compute[71063]: DEBUG nova.compute.manager [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Received event network-vif-deleted-363c768e-4cdf-4715-98c4-1bfce1e81e49 {{(pid=71063) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 17:35:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:35:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:35:55 user nova-compute[71063]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681234540.84048, 259f5df3-9c93-4e5e-82cc-5c350632534b => Stopped> {{(pid=71063) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 17:35:55 user nova-compute[71063]: INFO nova.compute.manager [-] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] VM Stopped (Lifecycle Event)
Apr 11 17:35:55 user nova-compute[71063]: DEBUG nova.compute.manager [None req-7f5726e7-898a-4b58-a3f1-39e221777fe1 None None] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Checking state {{(pid=71063) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 17:35:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:00 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:05 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:10 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:15 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:19 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:20 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Starting heal instance info cache {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 17:36:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Rebuilding the list of instances to heal {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 17:36:20 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Didn't find any instances for network info cache update. {{(pid=71063) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 17:36:20 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:25 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:26 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:26 user nova-compute[71063]: DEBUG nova.compute.manager [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71063) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 17:36:27 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:27 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:28 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Auditing locally available compute resources for user (node: user) {{(pid=71063) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 17:36:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:36:30 user nova-compute[71063]: WARNING nova.virt.libvirt.driver [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=26.27951431274414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71063) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71063) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.provider_tree [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed in ProviderTree for provider: 5e60710e-bd05-42a7-9d8e-dda73c9154fd {{(pid=71063) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.scheduler.client.report [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Inventory has not changed for provider 5e60710e-bd05-42a7-9d8e-dda73c9154fd based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71063) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG nova.compute.resource_tracker [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Compute_service record updated for user:user {{(pid=71063) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 17:36:30 user nova-compute[71063]: DEBUG oslo_concurrency.lockutils [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=71063) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 17:36:31 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:32 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:35 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:35 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:36 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:36 user nova-compute[71063]: DEBUG oslo_service.periodic_task [None req-48897771-74c2-4f49-9ffc-a3af6cf15cd7 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71063) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 17:36:40 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71063) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71063) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 17:36:45 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:50 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 17:36:55 user nova-compute[71063]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71063) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}